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1.  SUMMARY  OF  ACCOMPLISHMENTS 


The  major  emphases  of  the  research  proposal  submitted  to  the  Oflicr  ot  Nav  al 
Research  in  1986  were  in  the  development  of  new  techniques  fur  cube*  mi  MgnoJ 
identification  using  multiple  sensor  elements  and  performance  analysis  ot 
eigenstructure-based  high  resolution  methods  for  direction  finding. 

This  research  report  concerns  primarily  with  new  developments  (since  the  1»m 
report  date)  in  the  detection  of  signals  from  measurements  made  at  the  outputs  of  a 
set  of  spatially  deployed  sensor  elements.  Three  key  results  that  have  been  obtained 
during  this  investigation  is  reported  in  section  2  with  all  details.  To  be  specific:.  ihr\ 
are: 

In  the  context  of  coherent  signal  classification,  a  spatial  smoothing  scheme  f  mt 
suggested  by  Evans  et  al. ,  and  subsequently  studied  by  Shan  et  a! .,  is  further  investi¬ 
gated.  It  is  proved  in  section  2.1  that  by  making  use  of  a  set  of  forward  and  complex 
conjugated  backward  subarrays  simultaneously,  it  is  always  possible  to  estimate  any  K 
directions  of  arrival  using  at  most  3K /2  sensor  elements.  This  is  achieved  by  creating 
a  smoothed  array  output  covariance  matrix  that  is  structurally  identical  to  a  covariance 
matrix  in  some  noncoherent  situation.  By  incorporating  the  eigenstructure-based 
techniques  on  this  smoothed  covariance  matrix,  it  then  becomes  possible  to  correctly 
identify  all  directions  of  arrivals  irrespective  of  their  correlation. 

Section  2.2  presents  a  detailed  asymptotic  analysis  of  a  class  of  high  resolution 
estimators  for  resolving  correlated  and  coherent  plane  waves  in  noise.  These  estima¬ 
tors  are  in  turn  constructed  from  certain  eigenvectors  associated  with  spatially 
smoothed  (or  unsmoothed)  covariance  matrices  generated  from  a  uniform  array.  The 
analysis  is  first  carried  out  for  the  smoothed  case,  and  from  this  the  conventional 
MUSIC  (unsmoothed)  scheme  follows  as  a  special  case.  Independent  of  the  total 
number  of  sources  present  in  the  scene,  the  variance  of  the  conventional  MUSIC  esti- 


iiaioi  uut!^  >n«  wm  u'ftf-ti  n  »hu*n  to  he  zero  within  a  first-order  approxima- 
'“>»■  *'*'  ia  she  smoothed  case  are  used  to  obtain  a  resolu- 

:un  ni  iinoui  .w  ujfiKtxttt..  cv^-jf^mefcd  plane  wave  sources  in  white  noise,  and 
.')*i  «  iunt^^u!  *jj  ‘.?ut£  ofcf.,*ufacU  to/  two  uncorrelatcd,  equipowered  plane  wave 

t  >  ">k  'V'j i.  ouj*  i*c  aftahvn  presented  in  section  2.2  is  new  and 

.-.xjuid  hi  t  )i;r  s«  twxtrutfo  <ar  the  performance  evaluation  of  almost  all 

iiuisttkii:  •i|:,ur'«  iMiKiili  'WuISnu^l.a*’*, 

*  nuiiv  i  *•.>«*  the  directions  of  arrival  of  multiple  signals 

i'-ii.v.ru  \v  4t«r!i*r  **.w*iaicd  with  certain  matrices  generated  from 

juinrti  tuospiww  <itft«tn>-tv^oe«  *  prnfMscd  in  section  23.  This  is  carried  out  by 
)Kiir/-in£  i  *-{i!  j>rtop*ffn  otf  the  sjftul  uibvpace;  i.e.,  in  presence  of  uncorre- 

.uv-(!  in*.'  :*.Vnr:*;ai  umuoi*  sots*.  *hr  M*h»pace  spanned  by  the  true  direction  vectors 
■nmvtites  *.ft*  .on*  »p**rn*d  K  «Sc  eigenvector*  corresponding  to  all,  except  the 
;m,ii!*sf  **r  nf  f^.ar  n*  c4  the  array  output  covariance  matrix.  Further, 

ir:i:.;inj£  *h*  m  2 2.  a  fini-ordcr  perturbation  analysis  is  carried  out  to 

#v-4iu4f#  *he  perfiorm^nifc  of  jh««  scheme,  when  the  array  output  cross-covariances  are 
fsrimatesf  lfi*iom  the  dat*  In  its  leant  favorable  configuration,  unlike  the  MUSIC 
scheme,  the  hues  associated  with  the  dircctKWTsof-arnval  estimator  for  this  scheme  in 
a  >iv source  scene  «  sh nwrt  to  be  zero  and  tbc  variance  to  be  nonzero  within  a  first- 
order  approximation.  In  its  most  favorable  configuration,  both  bias  and  variance  are 
<hr**n  to  be  nonzero  for  tbc  same  source  scene.  Using  these  variance  expressions, 
re:  Vtuum  thresholds  are  obtained  for  two  closely  spaced  sources  in  an  equipowered 
scene  TV:  superior  performance  of  this  algorithm  in  its  most  favorable  configuration 
is  also  shown  to  be  in  agreement  with  actual  simulation  results. 

A  list  of  publications  or  iginated  under  this  contract  is  outlined  in  the  next  section. 
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TECHNICAL  REPORT 

2.1  Forward/ Backward  Spatial  Smoothing  Techniques  for 
Coherent  Signal  Identification 

2.1.1  Introduction 

In  recent  years,  considerable  effort  has  been  spent  in  developing  high  resolution 
techniques  for  estimating  the  directions  of  arrival  of  multiple  signals  using  multiple 
sensors.  These  methods  [l]-[4],  in  general,  exploit  specific  eigenstructure  properties 
of  the  sensor  array  output  covariance  matrix  and  are  known  to  yield  high  resolution 
even  when  the  signal  sources  are  partially  correlated.  However,  when  some  of  the  sig¬ 
nals  are  perfectly  correlated  (coherent),  as  happens,  for  example,  in  multipath  propa¬ 
gation,  these  techniques  encounter  serious  difficulties.  Several  alternatives  have  been 
proposed  [5] -[11]  to  take  care  of  this  situation,  of  which  the  spatial  smoothing 
scheme  first  suggested  by  Evans  et  al.  [9],  [10]  and  extensively  studied  by  Shan  et  al. 
[11],  [12]  is  specially  noteworthy.  Their  solution  is  based  on  a  preprocessing  scheme 
that  partitions  the  total  array  of  sensors  into  subarrays  and  then  generates  the  average 
of  the  subarray  output  covariance  matrices.  Shan  et  al.  have  shown  that  when  this 
average  of  subarray  covariance  matrices  is  used  in  conjunction  with  the 
eigenstructure-based  multiple  signal  classification  technique  developed  by  Schmidt 
[3],  in  the  case  of  independent  and  identical  sensor  noise,  it  is  possible  to  estimate  all 
directions  of  arrival  irrespective  of  their  degree  of  correlation.  However,  this 
forward-only  smoothing  scheme  makes  use  of  a  larger  number  of  sensor  elements 
than  the  conventional  ones,  and  in  particular  requires  2 K  sensor  elements  to  estimate 
any  K  directions  of  arrival. 

In  this  report,  we  analyze  an  improved  spatial  smoothing  scheme  -called  the 
forward/backward  smoothing  scheme-  and  prove  that  at  most  [3/C /2](l)  elements  are 
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enough  to  estimate  any  K  directions  of  arrival.  In  addition  to  the  forward  xuhaiiayv 
this  scheme  makes  use  of  complex  conjugated  backward  subarrays  id  the  animal 
array  to  achieve  superior  performance.  In  this  context,  it  is  instructive  to  note  the 
observations  of  Evans  et  al.[  10),  The  combined  effect  of  spatial  smoothing  and 
forward/backward  averaging  cannot  increase  an  array's  direction  lmding  capahdm 
beyond  [2A//3]  coherent  signals  (with  Si  representing  the  numivci  ol  smsui  ric 
ments)."  While  this  statement  is  correct  and  coincides  with  the  ■-  t  van: 

et  al.  do  not  provide  a  proof  for  it.  A  special  case  of  the  genera!  situation,  white  tht 
multipath  coefficients  are  treated  to  be  real,  is  proved  m  f 3 .*]  Mow-ort  this  i:  at 
unrealistic  assumption,  as  in  practice  all  multipath  c«ffiocnt»  Hr  mot »«*••*»  n it*, 
plex  numbers  and  in  that  case  it  is  necessary  to  rcaww.  different.1* 

For  clarity  of  presentation,  section  2  1  2  dca"»  with  a  <r«~.piete  ■»  nilic(  -n 
tion  and  proves  that  to  estimate  arts  K  coherer.*  d  rec*.i<-o«  ii*  a**'»a  t  u  .<  -it 
have  an  array  of  [SK /2\  sensors.  The  proof  fo*  tht  gr-* s.  »  •({  s.<  i  -w  «  oi  usc, 
the  Appendix. 

2.1.2  Direction  Finding  in  a  Coherent  fn»iro««*e»t 
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fVv*4! :*e  of  *V;*  %  4 -iV* «V  *f.  no  v.nf,-jr  combination  <>f  direction  vcc* 

vr<  car  i  •  —  ”“■«?*  <?  *ft'>or  f «w<(jiicniV  b  is  no  longer  a  legitimate 

direction  %ec*or  a-vj  V-cc  (12*  not  V  able  to  estimate  am  true  arrival  angles. 
TV  crucial  role  p  used  b>  the  rors-.rgular.ty  of  R  m  this  discussion  has  prompted 
f-Vars  «•?  a/  and  s;;Hsc,p;cn?\  Shan  of  al  to  introduce  a  preprocessing  scheme  [<))- 
[1 1|  which  guarantees  fu’l  rank  for  the  equivalent  R^  in  (S)  even  when  the  signals  are 
all  coherent  This  preprocessing  spatial  smoothing  scheme  starts  hv  dividing  a  uni¬ 
form  linear  array  with  If  ^  sensors  into  uniformly  overlapping  subarrays  of  size  M  (see 
Fig  I)  let  \'it)  stand  for  the  output  of  the  l'h  subarray  for  /  =  1,  2,  ,  L  = 
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Mq  -M  + 1,  where  L  denotes  the  total  number  of  these  forward  subarrays.  Using  (2) 
-  (6)  we  have 

T 

=AB,’Iu(t)  +  n/(f)  ,  1</<Z(13) 

where  B;  1  denotes  the  (/  -  l)f/l  power  of  the  K  xK  diagonal  matrix 

B  =  diag  •  •  •  ,uK\  ;  u  =  exp(  ia )  ,  i  =1,2 (14) 

Then,  the  covariance  matrix  of  the  l'h  subarray  is  given  by 

R;  -  E  [*/(*)(  */(/))*]  =  A B7 " 1  Ru  (B,"1)tAt  +  a1 1.  (15) 


following  (^]  (IIJ  define  the  forward  spatially  smrxithed  covariance  matrix,  as 
the  sample  mean  of  the  forward  suharray  covariance  matrices  and  this  gives 


AR  '  A*  ♦  o:l 


In  a  com plc'e'v  coherent  environment,  using  (JO»  the  fnrwardvmrxilhcd  source 

covariance  rrrn  R  ta'se-s  the  form 

* 


•*  S* 


<V 


(  o  Bo  Bo  B  o 


O 


rVar’v  *s*  *i~s  or-  R  >  <■  *  v  *V  ^  f  C.  -Kr ?  (  -  f)\  ^ 5  «hf 

marr-t  D  -s  of  ‘  *V  *.:■*  C  -<  -v  — -f  *V*  <-/  \  N-*»  *Sf  r,<  • 

A  »  l  V  an» le  of, •>  — i**  »  \  -i  f  \  -  —  -i  kj  v  -e r  /*■  \  *  -  A’  a  l  A 


- 11  - 


Thus,  if  L  =Mo  -M  +  1>K  or  equivalently  Mo>M  +K  -1,  the  smoothed  source 
covariance  matrix  R'  is  nonsingular  and  R  has  exactly  the  same  form  as  the  covari¬ 
ance  matrix  for  a  noncoherent  case.  Therefore  the  conclusions  in  (9)  will  hold  good 
for  R^  in  (16),  and  as  pointed  out  by  Shan  et  al.,  one  can  successfully  apply  the  eigen- 
structure  methods  to  this  smoothed  covariance  matrix  regardless  of  the  coherence  of 
the  signals.  However,  in  this  case,  the  number  of  sensor  elements  Mo  must  be  at  least 
(M  +K  -1),  and  recalling  from  (9)  that  the  size  M  of  each  subarray  must  also  be  at 
least  K  + 1,  it  follows  that  the  minimum  number  of  sensors  needed  is  2 K  compared  to 
K  + 1  for  the  conventional  one.  In  what  follows  we  present  the  improved  spatial 
smoothing  scheme  that  makes  use  of  the  forward  and  appropriate  backward  subarrays 
to  reduce  the  required  number  of  sensor  elements  to  [3 K  /2]. 


Towards  this  purpose,  additional  L  backward  subarrays  are  generated  from  the 
same  set  of  sensors  by  grouping  elements  at  { M0 ,  Mo  - 1,  •  •  ■  ,  Mo  -M  + 1 }  to  form 
the  first  backward  subarray  and  elements  at  { MQ  - 1,  MQ  -2,  •  •  •  ,  Mo  -Af  }  to  form 
the  second  one.  etc.  (see  Fig.  1).  Let  x,(/)  denote  the  complex  conjugate  of  the  out¬ 
put  of  the  l‘  backward  subarray  for  /  =  1,  2,  •  •  * ,  L,  where  L  as  before  denotes  the 
total  number  (Af,  -  Af  ♦  1)  of  these  subarrays.  Thus 


v  It ) 


i  •  t 


<'Wr 


-/('>•■ 


=  AB 


/  - 1 


+  fi/(0, 1  </(«•*) 


f  At 

where  R  is  as  defined  in  (14).  The  covariance  matrix  of  the  /  backward  subarray  is 
gp«en  b% 

R*  »  f;[x*(M(v  (M>'l  =  AB,_'R  (B/',)tAf  ♦  o'l  (20) 

U 


with 


.  T  IW.  -  il  .  -  (O.  -  1|  -(W„  -  I)  * 

R  *R  Lm’imh  injiR  )  =  B  RJ(B  )  (21) 

•V  Nrfore.  de*  ~e  *ue  s— n.r'-ed  backward  s;jbarra>  covariance  matrix  Rh  as 

the  sample  mea-  * V <e  <:;Sa**ax  co%a*  a-ec  matrices,  i  e  . 
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h  1  L 

R  =IS 

1=1 


<  = 


AR>' 


2  * 
cr  I. 


(22) 


In  a  competely  coherent  environment  Ru  is  given  by  (10)  and  in  that  case  using  (10)  in 
(21)  simplifies  to 

R  =66t,  (23) 

U 

where 


r  -(Af  -i) 

«  =  [*!, VAr  ;  sk  =  <"*  0  *  k  =  1,2,'  •  •  ,K  (24) 

with  vk,  k  =  1,  2,  •  •  •  ,  K  as  defined  in  (14).  Finally,  using  (23)  the  backward- 
smoothed  source  covariance  matrix  R*  is  given  by 

R‘  'IE  B'-'R.  (B'-’)'  =  i  EE*  (25) 

where 

E  =  [$,  B6,  B26,-  -  ,BL_15]  =  FV  (26) 

with  V  as  in  (18)  and 

F  =  diag  [6v62,  ■  -  •  ,6k].  (27) 

Reasoning  as  before  it  is  easy  to  see  that  the  backward  spatially  smoothed  covariance 
matrix  Rb  will  be  of  full  rank  so  long  as  R^  is  nonsingular,  and  this  is  guaranteed 
whenever  L  >K.  Again,  it  follows  that  the  backward  subarray  averaging  scheme  also 
requires  at  most  2 K  sensor  elements  to  estimate  the  directions  of  arrival  of  K  sources 
irrespective  of  their  coherence. 

It  remains  to  show  that  by  simultaneous  use  of  the  forward  and  backward  subar¬ 
ray  averaging  schemes,  it  is  possible  to  further  reduce  the  number  of  extra  sensor  ele¬ 
ments.  To  see  this,  following  Evans  et  al.  [10],  define  the  forward/backward  smoothed 
covariance  matrix  R  as  the  mean  of  R^  and  Rb ;  i.e. 


(28) 

(29) 

(30) 


=  [DV  |  FV]  =  D[V  |  HV]  =DG0,  (31) 

with  D,  V  as  in  (18)  and 

H  =  diag  [cj,  e2,  •  •  • ,  eK  ]  ;  ek  =  Sk  /ak  ,  k  =  1,  2,  •  •  • ,  K .  (32) 

We  will  now  prove  that  the  modified  source  covariance  matrix  Ru  given  by  (30)  will  be 
nonsingular  regardless  of  the  coherence  of  the  K  signal  sources  so  long  as  2L  >K , 
provided  that  whenever  equality  holds  among  some  of  the  members  of  the  set 
{  ek  }*  =  i  in  (32),  the  largest  subset  with  equal  entries  must  at  most  be  of  size  L . 

To  appreciate  this  restriction,  first  consider  the  case  where  all  ek,  k  =  1,  2,  •  •  ■  , 
K  are  equal.  In  that  case  it  is  easy  to  see  that  G0  and  hence  Ru  will  be  of  rank 
min(L^)  irrespective  of  the  backward  smoothing.  However,  in  practice  this  equality 
condition  almost  never  occurs.  This  is  because  ak  in  (1),  which  represents  the  com¬ 
plex  attenuation  of  the  kth  source  with  respect  to  the  reference  source,  is  a  signal  pro¬ 
perty,  and  Sk  in  (24),  which  is  a  function  of  the  interelement  phase  delay  of  the  klh 
source  with  respect  to  the  reference  element,  is  mainly  an  array  geometry  property. 
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Using  (16),  (17),  (22)  and  (25)  in  (28)  we  have 

R  =  A  2^-  (CCf  +  EEf)  Af  +  a2 1  =  ARMAf  +  a2! 

with 

K  =  227  [ C Cf  +  E Ef  ]  =  227  GGf. 

Here 

G  =  [a,Ba,B2a,  -  -  ,BL_1a,6,B5,  B25,-  *  ,BL_1«] 
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thus,  Lfi  aft  actual  utuaJuo^i  *il  «4 , 4  -  l,  2,  ,  K  will  be  distinct  and  the  simultane¬ 

ity*  equality  vtjiiditiuft  *n  ut  t.Vfii  moirv  it  aii  almost  never  occurring  event.  From 
theic  argument*  it  oIhj  folUjw*  that  the  aKwe  restrictions  on  the  equality  among  some 
of  the  t%  t  will  almost  al'wjryv  be  va'.nfscd  To  he  specific  with  regard  to  these  restric¬ 
tions,  wc  wtll  avuiffic  that 

t  * t  ,  for  am  1^1,2.  .  L,  and  j  »  L  ♦  1.  L  *2,  ■  ■  •  ,  K .  (33) 

A  special  case  of  the  general  situation.  where  all  ot .  A  ■  1.  2.  ••  •  .  K,  in  (1)  are 
real,  w  treated  tn  [13|  In  that  cave  using  (24)  and  (32)  in  (31)  it  is  easy  to  see  that  G0 
is  a  Vandermonde  rnatru  with  distinct  columns  and  hence  is  of  rank  K  so  long  as 
2L>K.  This,  however,  is  an  unrealistic  assumption,  xs  in  practice,  all  oks  will  be 
invariably  complex  numbers  and  in  that  case  it  is  necessary  to  argue  differently  xs  fol¬ 
lows. 

From  (30).  Ru  will  be  nonsingular  so  long  xs  G  is  of  full  row  rank,  and  using  (31) 
this  is  further  equivalent  to  having  full  row  rank  for  G0.  Clearly,  for  G  (or  G0)  to  have 

full  row  rank  it  is  necessary  that  2L>K  and  with  L  *  Mn  -M  +  1.  this  reduces  to 

2M0  >2 Vf  +A.  -2.  Again  recalling  that  in  the  presence  of  K  signals  the  size  Af  of  each 
subarrav  must  be  at  least  K  +  1,  it  follows  that  the  number  of  sensors  M  needed  must 
satisfy  2Mo  >3Af  or,  equivalently,  the  min;mum  number  of  sensors  must  be  at  least 
(3AT /2].  To  see  that  this  requirement  is  also  sufficient,  consider  the  quadratic  product 

y^G^y  =  yWvV  +  ytHVVt  Hfv  (34) 

where  y  is  any  arbitrary  K  x  1  vector.  We  will  show  that 

/GoG^y  >  0  (35) 

for  any  y  ^O,  thus  proving  the  positive-definite  property  of  G0G,|  or  Ru.  Clearly  (35) 
needs  to  be  demonstrated  only  for  a  typical  y0e  N(  Vf) ,  the  null  space  of  V*.  In  that 
case  V*y0  =  O  and  hence  the  first  term  in  (34)  reduces  to  zero.  To  prove  our  claim,  it 


is  enough  to  show  that  for  such  a  typical  y0,  H*y0  does  not  belong  to  N  ( Vt ).  Since  the 
Vandermonde  structured  matrix  V*  is  of  full  row  rank  L ,  the  dimension  of  N  ( V* )  is 
K  -L.  Let  \L  +1,  \L  +2,  •  •  • ,  v^.  be  a  set  of  linearly  independent  basis  vectors  for 
N(Vt).  With  respect  to  the  basis  vectors  for  the  -dimensional  space,  these  null 
space  basis  vectors  can  always  be  chosen  such  that  [14], 

T 

yt  =  [vi/’y2/*"‘  ,vu,0,-,0,  1,0,-,  0]  .  (36) 

(  In  (36)  the  1  is  at  the  Ith  location.)  These  vn  l  =  L  + 1,  L  +2,  •  •  • ,  K  are  linearly 
independent  and,  moreover,  for  any  j  6  {L  +  1,  L  +2, •  •  •  ,K},  using  the  diagonal 
nature  of  H  it  is  also  easy  to  see  that  hV  is  linearly  independent  of  the  remaining  v/t 
l  -  L  + 1,  •  •  • ,  K ,  /  fj .  Further  the  pair  \j  and  hV,  j  =  L  + 1,  L  +2,  •  •  •  ,  K,  is 
also  linearly  independent  of  each  other.  To  see  this  note  that  because  of  the  full  row 
rank  property  of  V*.  at  least  one  of  the  v//t  /  =  1,  2,  •  •  • ,  L  in  (36)  must  be  nonzero 
for  every  /.  Let  v(.  ■  be  such  an  entry  in  v- .  Then  the  minor  formed  by  the  i°  and  j'1' 
rows  of  the  matrix  [  \j  |  hV  ]  has  the  form 

and  is  nonzero  from  (33).  Thus  the  matrix  [  Vj  \  h\^  ]  is  of  rank  2.  This  proves  the 
linear  independence  of  \j  and  hV.  From  the  above  discussion  it  follows  that  hV  is 
linearly  independent  of  v  ,  j  =  L  + 1,  L  +  2,  •  •  • ,  K  and  hence  hV  £  N(V*),  j  = 
L  +  1,  L  +  2,  •••,  K.  Now  for  any  y0  €  N  ( V* )  we  have 

y0=  E  <38> 

j  mL  *  1 


(37) 


which  gives 
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Since  all  k cannot  be  zero  in  (39),  it  follows  that  H*y0£N(Vf)  and  hence 
V*  Hfy0  ?  O.  This  proves  our  claim  and  establishes  that  RM  will  be  nonsingular  under 
the  mild  restrictions  in  (33).  In  that  case  the  eigenvalues  of  R  satisfy  Aj>  A^  •  •  • 
>A K  >A^  +  1  =  Ax+2  =  •••  XM  =  a2.  Consequently,  as  in  (9),  the  eigenvectors 
corresponding  to  equal  eigenvalues  are  orthogonal  to  the  direction  vectors  associated 
with  the  true  directions  of  arrival;  i.e. 

0-  a(w*)  =  0,  i  =  K  +  \,K  +2,  •*,Af,  k  =  1,2,  •••  ,K  (40) 

Here  0V  0V  •  •  • ,  0M  are  the  eigenvectors  of  R  corresponding  to  the  eigenvalues  Xv 
respectively. 

To  summarize,  we  have  proved  that  so  long  as  the  number  of  sensor  elements  is 
at  least  [3AT /2],  (with  K  representing  the  number  of  signal  sources  present  in  the 
scene),  it  is  almost  always  possible  to  estimate  all  arrival  angles  irrespective  of  the  sig¬ 
nal  correlations  by  simultaneous  use  of  the  forward  and  backward  subarray  averaging 
scheme.  Since  the  smoothed  covariance  matrix  R  in  (28)  has  exactly  the  same  form  as 
the  covariance  matrix  for  some  noncoherent  situation  as  in  (8),  the  eigenstructure- 
based  techniques  can  be  applied  to  this  smoothed  covariance  matrix,  irrespective  of 
the  coherence  of  the  signals,  to  successfully  estimate  their  directions  of  arrival. 

The  Appendix  extends  the  proof  for  the  forward/backward  smoothing  scheme  to 
a  mixed  source  scene  consisting  of  partially  correlated  signals  with  complete  coher¬ 
ence  among  some  of  them. 

2.13  Simulation  Results 

In  this  section  simulation  results  are  presented  to  illustrate  the  performance  of 
the  forward/backward  spatial  smoothing  scheme  and  to  compare  it  with  the  conven¬ 
tional  eigenstructure-based  techniques  (3). 

Fig.  2  represents  a  coherent  source  scene  where  the  reference  signal  arriving 
from  70°  undergoes  multipath  reflection,  resulting  in  three  additional  coherent  arrivals 
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along  45°,  115°  and  127°.  A  six-element  uniform  array  is  used  to  receive  these  signals. 
The  input  signal- to- noise  ratio  (SNR)  of  the  reference  signal  is  5  dB,  and  the  attenua¬ 
tion  coefficients  of  the  three  coherent  sources  are  taken  to  be  (0.4, 0.8),  (-0.3,  -0.7) 
and  (0.5,  -0.6),  respectively.  In  the  notation  a  =  (a,b),  here  a  and  b  represent  the 
real  and  imaginary  parts,  respectively,  of  the  complex  attenuation  coefficient  a.  Three 
hundred  data  samples  are  used  to  estimate  the  array  output  covariance  matrix  using 
the  standard  maximum  likelihood  procedure.  The  application  of  the  conventional 
eigenstructure  method  [3]  to  this  covariance  matrix  resulted  in  Fig.  2.a.  However,  first 
applying  the  forward/backward  spatial  smoothing  scheme  with  two  forward  and  two 
backward  (L  =2)  subarrays  of  five  ( M  =5)  sensors  each,  and  then  reapplying  the 
eigenstructure  technique  on  the  smoothed  covariance  matrix  R  resulted  in  Fig.  2.b.  All 
four  directions  of  arrival  can  be  clearly  identified  and  the  improvement  in  perfor¬ 
mance  in  terms  of  resolvability,  irrespective  of  the  signal  coherence,  is  also  visible  in 
this  case. 

2.1.4  Conclusions 

This  report  reexamines  the  problem  of  locating  the  directions  of  arrival  of 
coherent  signals  and  in  that  context  a  spatial  smoothing  scheme,  first  introduced  by 
Evans  et  al.  and  analyzed  by  Shan  et  al. ,  is  further  investigated.  It  is  proved  here  that 
by  simultaneous  use  of  a  set  of  forward  and  complex  conjugated  backward  subarrays, 
it  is  always  possible  to  estimate  any  K  directions  of  arrival  using  at  most  [7>K  /2\  sen¬ 
sor  elements.  This  is  made  possible  by  creating  a  smoothed  array  output  covariance 
matrix  that  is  structurally  identical  to  a  covariance  matrix  in  some  noncoherent  situa¬ 
tion,  thus  enabling  one  to  correctly  identify  all  directions  of  arrival  by  incorporating 
the  eigenstructure-based  techniques  [3]  on  this  smoothed  matrix.  This  is  a  consider¬ 
able  saving  compared  to  the  forward-only  smoothing  scheme  [11]  that  requires  as 
many  extra  sensor  elements  as  the  total  number  of  coherent  signals  present  in  the 


scene. 


-  18- 


Appendix 


Coherent  and  Correlated  Signal  Scene 

We  will  demonstrate  here  that  the  forward/backward  smoothing  scheme  dis¬ 
cussed  in  section  2.1.2  readily  extends  to  the  general  situation  where  the  source  scene 
consists  of  K  +J  signals  u  }(r  ),  u  2(f ),  •  •  • ,  uK  ( I ),  uK^l(t),  •••  ,  uK  (t ),  of  which  the 
first  K  signals  are  completely  coherent  and  the  last  (7  +  1)  signals  are  partially  corre¬ 
lated.  Thus  the  coherent  signals  are  partially  correlated  with  the  remaining  set  of  sig¬ 
nals.  Further,  the  respective  arrival  angles  are  assumed  to  be  $v  82,  •  •  •  ,  $K,  0K  „ ,, 
•  •  •  ,6K^j.AiS  before,  the  signals  are  taken  to  be  uncorrelated  with  the  noise  and  the 
noise  is  assumed  to  be  identical  and  uncorrelated  from  element  to  element.  With  sym- 

tft 

bols  as  defined  in  the  text  and  using  (2),  the  output  jr  (t )  of  the  i  sensor  element  at 
time  t  in  this  case  can  be  written  as 

K  K  ♦/ 

*,■(0  =«j(0  £  exp( -;(i -IV*)  +  £  «*(Oexp(-/(/ -l)w*) +/!,■(/), 

k-  1  k  -1 

i  =  1,  2, •  *  •  ,M.  (A.1) 

With  x(t )  as  in  (3),  this  gives 

x(f )  =  Av(r)  +  n(r),  (A.2) 

where 

A  =  \fM  [a((j,),  a (w2),  •  •  ■ ,  a(uK ),  +  ,),•••  ,  a^.  +/  )J  (A.3) 

with  a(u Jk  );k  =  1, 2, •  •  * , K  +J  as  defined  in  (7)  and 

*(')  -  [»,(<)  I  “:(')]•  (A.4) 
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with  a  as  in  ( 10)  and 

T 

^(O  =  [WJK  ♦  l^)*  UK  *2^  )»  *  »  UK  +/(0]  •  (A-6) 

Following  (13) -(17),  (19) -(20),  (25)  and  (28),  the  forward/backward  smoothed 
covariance  matrix  R  in  this  case  can  be  written  as 

R  =  ARqA*  +  <r2I,  (A.7) 

where 

R»-^Eb''i(R^R)(b'")'.  (A.8) 

/-I 

It  remains  to  show  that  Rq  is  of  full  rank  irrespective  of  the  coherency  among  some  of 
the  arrivals.  Here 


B  = 


Bi  O 

L0  b2 


where 


and 


with  uk  ,  k  =  1,  •  •  • ,  K  +/  as  given  by  ( 14)  and 


Rj,  R12 


^12  ^22 


R.  ^  { v(f )  v’fr )]  = 

Using  (A.4)  -  (A.6),  it  is  easy  to  see  that 

Rn  =  £[u1(r)ult(r)]  =  aaf 
2 

where  a  is  as  before  and  E  [  \u  ,(/ )  |  ]  =  1.  Similarly 

Rj2  =  £[u,(Ouj(0]  =  oV 


(A-9) 


-  '^K  ) 

(A.  10) 

!’  '  '  '  ’  UK  +/  1 

(A.  11) 

(A.  12) 


(A.  13) 


(A.  14) 


with 
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7  =  [71»72»-''  ,7/]  , 


(A- 15) 


where 


7,-  i  =  1, 2,*  •  • , 


(A.  16) 


R22  =£[u2(0u2t(0]- 


(A.  17) 


From  the  partially  correlated  assumption  among  the  later  J  signals,  it  follows  that 
their  correlation  matrix  is  of  full  rank  and  hence  it  has  the  representation 


1*22  =  A  A* 


(A.  18) 


where  A  is  again  a  full  rank  matrix  of  size  /  x/.  In  a  similar  manner  following  (21),  R. 


can  be  written  as 


Ro 


and  proceeding  as  before, 


*u-«' 


(A.  19) 


(A.20) 


with  6  as  in  (24)  and 


*,2  = 


(A.21) 


7  =  [  7P  72. '  •  •  .  7;  ]T  . 


(A.22) 


where 


-(.W  -t) 

7,  =  I*  UK  ,  f  =  1,2, 


(A.  23) 


Here  7,  is  as  defined  in  (A.16)  and  vK  +1  is  obtained  by  extending  the  definition  in 
(14).  Further, 


B22  =  B2 


-(Af  -1)  .  . 

,  R„(B?  )f  =  AAT 


(A. 24) 


-  :i  • 


with 


-vW  !■ 

a  -  ft.  a 


where  A  agam  n  a  full  rank  Puifa  erf  »^e  1  *)  \fcdfc  (A^l  (A'4)  tn 
'umpUfuc*  it> 


K 


t 


i 

V  ft 


£ 

A’  ft. 


I*..  •  l.Mft  7 


v  #;  3 («,. .  ft  .*<»:  7 

<  *  3 


ift'.  •ft'.Mtt;  7  v  ft!  J(K..  •  ft.. mb!  7 

*  *  ~  w  «<•  < 


J 

2/, 


1 

G. 

O 

< 

g! 

* 

G;  G, 

G.r.; 

*  21 

G, 

* 

G« 

o 

g4V 

where 


G,  =  la.  B.  a.  •  •  •  ,  fl!  1  a,  6,  B.S,  -  ■  ■  ,  b!'  1  Si , 


G2  =  [*T*  B27.*  *  '  •  n2 ■  _l7.7.  B27.’  '  ,  B2'  "  1  nr]  » 
G,  =  [  A .  B:  A .  •  •  •  ,  B2  ~ 1  A ,  A ,  B,  A,  •  •  •  ,  ” 1  a]  , 


and  G4  satisfies 


GjG]  =  G2G2t  +  G4G4t. 


tA2>) 
(AS>.  it 


(A.  26) 

(A.27) 

(A.28) 

(A.  29) 


(A.30) 


Define 


Then 


R»  -  Jl6 6' 


(A.31) 


(A.32) 


Clearly  the  rank  of  Ry  is  the  same  as  that  of  G.  An  examination  of  (A.27)  shows  that 
GjGj  is  the  average  of  the  source  covariance  matrix  corresponding  to  the  completely 
coherent  situation  (see  (31))  and  hence  from  the  result  derived  in  section  2.1.2,  it  fol¬ 
lows  that  Gt  gJ  is  of  full  rank  K  so  long  as  L>[K / 2].  Now  it  remains  to  show  that  G4 
is  also  of  full  row  rank/  ,  which  together  with  (A.31)  implies  that  G  and  hence  Rq  is  of 
full  rank  K  +/.  From  (A.28)  -  (A.30)  we  have 

G4G4'  =  G,G,‘  -  G,c! 


E  b'‘1(AA,-t,t,,)(b'‘I),+  S  B'-'fAA'-TrTr'HB'-1)' 


/  -1 


/  =  1 


(A.33) 


In  the  first  summation  here,  A  and  7  are  matrices  of  ranks  J  and  1  respectively  and 
hence  the  matrix  (AA^-^V'  '  at  least  of  rank/-l.  Once  again,  resorting  to  the 
argument  used  in  establishing  (35)  in  section  2.1.2,  it  follows  that  each  summation  and 
hence  G4  is  of  full  row  rank  /  so  long  as  L  >  1.  This  establishes  the  nonsingularity  of 
R0  for  L  >[K /2].  As  a  result,  the  smoothed  covariance  matrix  R  in  (A.7)  has  struc¬ 
turally  the  same  form  as  the  covariance  matrix  for  some  noncoherent  set  of  K  +J  sig¬ 
nals.  Hence,  the  eigenstructure-based  techniques  can  be  applied  to  this  smoothed 
matrix  irrespective  of  the  coherence  of  the  original  set  of  signals  to  successfully  esti¬ 
mate  their  directions  of  arrival.  This  completes  the  proof. 
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Fig.  1  The  Fonvard/Backward  Spatial  Smoothing  Scheme 
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Fig.  2  Direction  finding  in  a  coherent  scene.  A  six-element  uniform  array  receives  signals  from  four 
coherent  sources  with  multipath  coefficients  (0.4,08),  (1,0.),  (-0.3, -0.7)  and  (0.5, -0.0).  The  arrival 
angles  of  the  four  coherent  signals  arc  45°,70°,  115’  and  127*.  Input  SNR  of  (he  reference  signal  is  5 
dH.  Three  hundred  data  samples  arc  used  to  estimate  the  covariance  matrix,  (a)  P(&)  using  the 
conventional  MUSIC  scheme,  (b)  P(6)  using  the  forward  /backward  smoothing  scheme. 
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2.2  Performance  Analysis  of  MUSIC-Type  High  Resolution  Estimators 
for  Direction  Finding  in  Correlated  and  Coherent  Scenes 

2.2.1  Introduction 

Eigenstructure-based  techniques  that  yield  high  resolution  have  been  a  topic  of 
great  interest  in  array  signal  processing  since  the  well-known  works  of  Pisarenko  [1], 
Schmidt  [2]  and  others  [3] -[8].  These  methods,  in  general,  utilize  certain  eigenstruc- 
ture  properties  resulting  from  the  special  structure  of  the  sensor  array  output  covari¬ 
ance  matrix  for  planar  wavefronts  [2]  to  generate  spectral  peaks  (or  equivalently  spec¬ 
tral  nulls)  along  the  actual  directions  of  arrival  and  are  known  to  yield  high  resolution 
even  when  some  of  the  sources  are  partially  correlated.  In  coherent  situations,  such  as 
multipath  propagation,  a  direct  application  of  these  techniques  results  in  ambiguity, 
and  specific  modifications  have  been  suggested  to  remedy  this  problem  [9] -[11].  Of 
these,  the  spatial-smoothing  scheme,  originally  suggested  by  Evans  et  al.  [9]  and  stu¬ 
died  by  Shan  et  al.  [10],  is  based  on  a  preprocessing  scheme  that  for  a  uniform  array, 
partitions  the  total  array  of  sensors  into  subarrays  and  then  generates  the  average  of 
the  subarray  output  covariance  matrices.  Further,  in  the  case  of  independent  and 
identical  sensor  noise,  this  mainx  is  shown  to  be  structurally  equivalent  to  that  in  some 
correlated  scene  thereby  making  it  amiable  to  the  above  mentioned  methods.  How¬ 
ever,  this  smoothing  scheme  -  we  call  it  the  forward-only  smoothing  scheme  -  requires 
2 K  sensor  elements  to  estimate  K  coherent  directions  of  arrival.  In  contrast  to  this,  a 
modified  scheme  also  proposed  by  Evans  et  aL  -  we  call  it  the  forward/backward 
smoothing  scheme  -  uses  both  forward  and  backward  subarrays  for  averaging  and  is 
shown  to  require  only  [3K- /2](1^  sensors  to  estimate  any  K  directions  of  arrival  [9,  12]. 

When  the  exact  ensemble  array  output  covariances  are  used,  all  these  methods 
result  in  unbiased  values  (i.e.,  zero  for  the  null  spectrum)  along  the  true  arrival  angles 
irrespective  of  signal-to-noise  ratios  (SNRs)  and  angular  separations  of  sources. 


(1)  The  symbol  [x]  stands  for  the  integer  part  of  x. 
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However,  when  these  covariances  are  estimated  from  a  finite  number  of  independent 
snapshots,  these  techniques  exhibit  deviations  from  their  ensemble  average  values. 
These  deviations  depend  on  the  specific  scheme  under  consideration  together  with  the 
SNRs  and  other  signal  and  array  specifications.  All  this  taken  together  determine  the 
resolution  capacity  of  the  technique  under  consideration. 

This  report  presents  a  performance  analysis  of  these  smoothing  techniques  when 
covariances  estimated  from  a  large  sample  size  are  used  in  place  of  their  ensemble 
averages.  The  analysis  for  the  general  forward/backward  scheme  is  carried  out  first 
while  the  forward-only  scheme  and  the  conventional  unsmoothed  (MUSIC)  scheme 
are  derived  as  special  cases. 

This  report  is  organized  as  follows:  For  the  sake  of  completeness,  the  forward- 
only  and  the  forward/backward  smoothing  schemes  are  summarized  in  section  2.2.2. 
Using  results  derived  in  Appendix  A,  section  2.2.3  presents  the  first-order  approxima¬ 
tions  to  the  mean  and  variance  of  the  null  spectrum  corresponding  to  the 
forward/backward,  the  forward-only  and  the  standard  MUSIC  schemes.  The  bias 
expression  in  the  case  of  the  forward/backward  scheme  is  used  to  obtain  a  resolution 
threshold  for  two  completely  coherent,  equipowered  plane  wave  sources  in  white 
noise;  and  this  result  is  compared  to  the  resolution  threshold  obtained  by  Kaveh  et  cil 
[13]  for  two  uncorrelated,  equipowered  plane  wave  sources  in  white  noise.  Finally,  in 
Appendix  B,  several  identities  that  are  found  to  be  useful  for  performance  analysis  are 
developed. 

2.2.2  Problem  Formulation 

Let  a  uniform  array  consisting  of  M  sensors  receive  signals  from  K  narrowband 
sources  u{(t),u2(t),  •  •  •  ,uK  (t),uK  +  p  •  •  • ,  uK  (t ),  of  which  the  first  Ko  signals  are 
completely  coherent  and  the  last  (K  -Ko  + 1)  signals  are  partially  correlated.  Thus  the 
coherent  signals  are  partially  correlated  with  the  remaining  set  of  signals.  Further,  the 
respective  arrival  angles  are  assumed  to  be  0p  02,  "  ‘  ^  ^  +i>  ' ' ' .  0K  with  respect 
to  the  line  of  the  array.  At  any  instant,  the  first  Ko  signals  u  j(f ),  u 2(t ),  •  •  •  ,  uK  (t ), 
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are  phase-delayed,  amplitude-weighted  replicas  of  one  of  them  -  say,  the  first  -  and 
hence 

uk(t)  =  aku{(t),  k  =  1,2,  •••  ,Ko  (1) 

th 

where  ak  represents  the  complex  attenuation  of  the  k  signal  with  respect  to  the  first 
signal,  u  { (/).  Using  complex  signal  representation,  the  received  signal  x.(t)  at  the  ith 
sensor  can  be  expressed  as 

(0  *  E  uk (O' exp (  -j* (/  - 1) cos ek  )  +  nt (t ).  (2) 

k  -l 

Here  the  interelement  distance  is  taken  to  be  half  the  wavelength  common  to  all  sig¬ 
nals  and  n.(t)  represents  the  additive  noise  at  the  i'h  sensor.  It  is  assumed  that  the  sig¬ 
nals  and  noises  are  stationary,  zero  mean  circular  Gaussian  ^  independent  random 

processes,  and  further,  the  noises  are  assumed  to  be  independent  and  identical 

2 

between  themselves  with  common  variance  a  .  Rewriting  (2)  in  common  vector  nota¬ 
tion  and  with  uk  =  tt  cos &k  ;  fc  =  1, 2,  •  *  * ,  K,  we  have 

T 

X(0  =  [x1(r),x2(0,  •••  =Au(0  +  n(0  (3) 

where 

T  T 

u(0  =  u2(0.  '••,«*(/)]  .  *(t )  =  ['»1(0,« 2(0.  .«Af(;)]  (4) 

and 

A  =  Vm  [a(wj),  a(u/2),  •  •  • ,  a(wK )|  (5) 

Here  a(u>k )  is  the  normalized  direction  vector  associated  with  the  arrival  angle  0k ;  i.e., 

(2)  A  complex  random  vector  z  is  defined  to  be  circular  Gaussian  if  its  real  part  x  and 
imaginary  part  y  arc  jointly  Gaussian  and  their  joint  covariance  matrix  has  the  form  [14,171 


where  z  =  x  +  j  y.  When  z  has  zero  mean,  its  covariance  matrix  is  given  by 
E  [zz*]  =e[(x  +  ;'y)(xr  —  / yr ) ]  =  V  +  ;W.  Clearly,  f[zzr  j  =  O.  Here  onwards  T  and  t 
represent  the  transpose  and  complex  conjugate  transpose,  rcpcctivcly. 
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1 

a^)  =  Vm  [l'exP(-iuk)'exP(~i7uk)'  *” ♦  exP(~/(A/-1K)j  •  (6) 

Notice  that  A  is  an  A/xAT  Vandermonde-type  matrix  (M  >/Q  of  rank  K  and  from  our 
assumptions  it  follows  that  the  array  output  covariance  matrix  has  the  form 

R  =  E  [x(r)xf(0]  =  ARM  Af  +  a2I .  (7) 

The  source  covariance  matrix  R u  =  E  [u(/)u*(0]  remains  as  nonsingular  so  long  as 
the  sources  are  at  most  partially  correlated.  In  that  case  ARm  A*  is  also  of  rank  K  and 
hence,  if  Aj^A^-**  >XM  and  0V  /?2.  •••,  are  the  eigenvalues  and  the 
corresponding  eigenvectors  of  R  respectively,  i.e., 

R=£A (8) 

/- 1 

2 

then  the  above  rank  property  implies  that  A^  +  1  =  A^+2  =  *  •  •  =  A M  -  a  and  conse¬ 
quently  0ja(uk)  =  0,  /  =K  +  l,K  +2,  •  •  •  Hence  the  nulls  of 

Q  (w)  given  by 

CH=  E  I/J]a(u,)|2  =  1  -  £  |^a(u)|2  (9) 

k=K+ 1  k- 1 

correspond  to  the  actual  directions  of  arrival.  However,  when  some  signals  are 
coherent  as  in  (1),  Ru  is  singular  and  the  above  conclusions  are  no  longer  true. 

To  circumvent  this  crucial  missing  rank  problem,  in  the  forward-only  spatial 
smoothing  scheme[9,  10]  a  set  of  overlapping  forward  subarrays  are  generated  by 
dividing  a  large  uniform  array  with  MQ  sensors  into  sets  of  size  M .  Let  xf  ( t )  stand  for 
the  output  of  the  Ith  subarray  for  /  =  1,  2,  •  •  • ,  L  -M0  -M  + 1  where  L  denotes  the 
total  number  of  these  forward  subarrays.  Then  the  covariance  matrix  of  the  Ith  subar¬ 
ray  is  given  by 

r/  =  £  [x/(/)(x/(l))'j  -  AH',  A*  +  oh  (10) 

where  R^  t  is  the  source  covariance  matrix  (singular)  of  the  Ith  forward  subarray  and 


the  average  of  these  subarray  covariance  matrices  has  the  form 


Rz  - r e  R/  = A (r  s  R«./| A' +  4ar*a'  +  "2l-  <n) 

/ -l  /-l 

Here  represents  the  smoothed  source  covariance  matrix  of  rank  p(R^)  =  K  - 
Ko  +  min(^o ,  L ).  Thus  if  L  =  Mo  -M  + 1  >Ko  the  smoothed  source  covariance  matrix 
is  nonsingular  and  R^.  has  exactly  the  same  form  as  the  covariance  matrix  in  some 
noncoherent  situation. 

To  improve  upon  the  number  of  extra  elements  needed  for  smoothing,  a  set  of  L 
additional  backward  subarrays  are  generated  in  [9,  12]  from  the  same  set  of  sensors  by 
grouping  elements  at  Mo,Mo-\,  •  •  • , M0  -M  + 1  to  form  the  first  backward  subar¬ 
ray,  etc.  Let  x*(t)  denote  the  complex  conjugate  of  the  output  of  the  Ith  backward 
subarray  and  R^  the  corresponding  subarray  covariance  matrix  for  /  =  1,  2,  •  •  •  ,  L . 
Then 

R/*  -  E  [x(b(» )  (x‘(( ))’]  =  ARb  ,  A*  *  ct2I  ( 12) 

where  R*  l  is  the  source  covariance  matrix  of  the  Ith  backward  subarray  and  the  aver¬ 
age  of  the  subarray  covariance  matrices  has  the  form 

Rt  =  rE  <  =  Afrs:  R«,1A'  +  ^i^ar„‘a'  +  02i.  (o> 

/-l  /-l 

Combining  the  forward  and  backward  smoothing  schemes  together,  we  define  the 
forward/backward  (f/b)  smoothed  covariance  matrix  as 

r4t(R,  +R„)  =  ar„a,  +  <72i=  2  W/  O4) 

Z  /  =  1 

where  the  smoothed  source  covariance  matrix 

R„  =  7(r„7  +  R.‘)  (15) 

can  be  shown  [12]  to  have  rank  p(RM )  =  A  Ko  +  min(/Co,2L).  So,  for  Rw  to  possess 


-32- 


full  rank,  2L>Ko  or  2 Mo  >2M  +K0  -2.  Recalling  that  in  a  coherent  situation 
(K  =Ko),  M  must  be  at  least  K  + 1,  it  follows  that  the  minimum  number  of  sensors 
must  be  at  least  [3K  /2].  More  precisely,  the  above  conclusion  is  valid,  provided  that 
whenever  equality  holds  among  some  of  the  member  of  the  set  {ek  {  with  ek  = 
(ak/otk )  exp( j  (Mo  -1)^),  the  largest  subset  with  equal  entries  is  at  most  of  size  L 
[12].  Under  these  conditions  Ru  is  of  rank  K  and  hence  the  eigenvalues  of  R  satisfy 
‘ '  >  \  +  1  =  A^+2  =  •  •  •  =  \M  =  a .  Consequently,  as  in  (9)  the  nulls  of 

Q  (w)  given  by 

M  IC 

{?(«)-  E  l#«(")l2  =  i  -  E  l«»HI2  0<>) 

*=K+1  k-1 

correspond  to  the  actual  directions  of  arrival 

So  far  we  have  assumed  that  an  ensemble  average  of  the  array  output  covari¬ 
ances  are  available.  Generally,  a  finite  data  sample  is  used  and  estimation  is  carried 
out  for  the  unknowns  of  interest  using  the  maximum  likelihood  procedure. 

For  zero  mean  M-variate  (circular)  Gaussian  data  x(tn)  ;n  =  1,  2,  •  •  •  ,N  in  (3), 
with  unknown  MxM  covariance  matrix  R,  the  maximum  likelihood  (ML)  estimate  S 
of  the  covariance  matrix  is  given  by  [16,  17] 

S-  jf  E  (17) 

n  -1 

Using  the  invariant  property  of  the  maximum  likelihood  procedure,  the  corresponding 
estimates  S^,  Sb  and  S  for  the  unknown  smoothed  matrices  R^,  Rb  and  R  can  be  con¬ 
structed  from  S  by  the  same  rule  that  is  used  in  constructing  R^ ,  Rb  and  R,  respec¬ 
tively,  from  R.  Thus,  for  example, 

S-y^+S,,)  (18) 

and 

(3)  Notice  that  these  arguments  can  be  readily  extended  to  several  groups  of  signals  where  the 
signals  arc  coherent  within  each  group,  but  incoherent  between  groups.  In  that  case  the 
additional  number  of  sensors  required  to  estimate  all  incoming  arrival  angles  can  be  shown  to 
be  \KmM/2),  where  represents  the  size  of  the  largest  coherent  group  of  signals. 
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s/  -  r  p  s!  =  ~NLpl  \  4 («) 

In  what  follows  we  study  the  statistical  properties  of  these  estimated  smoothed  covari¬ 
ance  matrices  and  their  associated  sample  estimators  for  direction  finding. 

2.2.3  Performance  Analysis 

2.2.3.A.  Main  Results 

In  this  section  the  statistical  behavior  of  the  forward-only  and  forward/backward 
smoothing  schemes  is  examined.  These  results  are  made  use  of  in  deriving  expres¬ 
sions  for  the  bias  and  the  resolution  threshold  of  two  equipowered  coherent  sources, 
and  comparisons  are  made  with  similar  results  obtained  for  uncorrelated  sources  [13]. 
Towards  this  purpose,  consider  the  eigen-representation 

S  =  ELEf  (20) 

for  the  ML  estimate  of  the  f/b  smoothed  matrix  R,  with 

E  =  [6^  e2,  •  •  •  ,  eK,  ®*  +  i » ' ' '  »  1 

L  =  diag  [/  i»  1 2*  ’  ’  *  ’  IfC  + 1»  *  l m  1 

and 

ee'  =  lM 

where  eu  >0,  i  =  1,  2,  •  •  •  ,  M  for  uniqueness.  Here  the  normalized  vectors 
er  e2,  •  •  • ,  eK  are  the  ML  estimates  of  the  eigenvectors  P2,  •  •  •  ,  of  R  respec¬ 
tively.  Similarly,  lv  l2,  •  •  • ,  lK  are  the  ML  estimates  of  the  K  largest  and  distinct 
eigenvalues  X2,-  •  •  ,XK  and  the  mean  of  lK  +  1, *  •  •  ,  lM  is  the  sample  estimate  of  the 
repeating  lowest  eigenvalue  a  of  R.  Following  (16),  the  sample  direction  estimator 
can  be  written  as 

{?(«)-  E  l«/»(“')|2  =  1  -  E  l«/a(“)|2-  (21) 

k-K+ 1  k~ 1 


The  asymptotic  distribution  of  the  estimates  of  the  eigenvalues  and  eigenvectors 
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associated  with  the  distinct  eigenvalues  of  R  is  derived  in  (A.31)  -  (A.32)  Appendix  A. 
Corresponding  results  for  the  forward-only  scheme  in  (11)  and  the  conventional 
scheme  in  (8)  can  be  readily  evaluated  as  special  cases  of  this  general  result.  It  is  also 
shown  there  that  the  estimated  eigenvalues  and  a  specific  set  of  corresponding  unnor¬ 
malized  eigenvectors  are  asymptotically  (in  the  sense  of  large  N)  jointly  Gaussian  with 
means  and  covariances  as  derived  there  (See  (A.33)  and  (A.34)).  Further,  after 
proper  renormalization  and  using  an  exact  relationship  among  the  different  sets  of 
eigenvectors,  it  is  shown  in  Appendix  A  that  (see  (A.39)) 

a  _  1  KM  ^ iikk  .  f  7 

e  [<2mj  -  CM  +  y  E  E - 7  I W I 

kfi  '  * 

M  M  ^ iikl  +  .  _  t  -> 

-EE  - iWjW  +  o  ( l/N2)  (22) 

(\  -\)(A,.  -A,) 

kfil  1  fit  '  K  l  I 

where  from  (A.  16) 


s  e  + tiKiWK*! 


p  •  i  <?  -i 


+  l  <,  A  *  A*  K,.  h  V  <,  A  ] 


with  7( .,  /  =  1,  2,  •  •  •  ,  A/  as  defined  there  and  R^,  R^  as  in  (A.  17). 

Similar  bias  expressions  for  the  forward-only  smoothing  scheme  can  be  obtained 
from  (22)  by  replacing  (23)  with  (A.  18).  In  particular  for  the  conventional 
(unsmoothed)  MUSIC  case  with  (A.  19)  in  (23),  after  some  simplifications  (22) 
reduces  to 


1  K  [  m  W 


E[Q{u)]  =  Q{uJ)  +  jJY,  E 


11  i:1 

k  fi  '  K 


(l^aMI2-  !^a(u;)|2)  +o(l/A:) 


1  K 

-  CM  *  n  E  - 77 

(A,  -  of 


((AT -#f) \fiJaM  |2  -  CM)  +o(l /N2)  (24) 
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where  A) ? ,  ,  i  =  1, 2,  •  •  • ,  M,  are  as  defined  in  (8)  and  Q  (u)  is  given  by  (9). 

Similarly,  from  (A.42) 

Var(£(u))  =  a\ui)  = 

2  k  k  m  m  +  tkjli*\u>)PiP]Ku))  aV)0*#a(w)] 

F  £  E  E  £  I  :  7  I 

'-l -\> 

+  o(l/N2)  (25) 

which  for  the  conventional  MUSIC  case  reduces  to 

t=i  Q.  -A.  r 


i  =1 


a,.a 

- -  |  ^/a(w)  | 2  |  ^a(w)  | 2 

(A,  “  Ay  )2 


+  o(l/W2) 


2  K  M 

=  IS  s 

(=1  *=*  +  1 


\\ 

- -  |^a(o,)|2|^a(o,)|2  +  0(1/JV2) 


QM  S 

i-l 


A,a 


/  \  2\  2 

(A,  -  <7  ) 


|^a(w)|2  +  o(l/W2). 


(26) 


Since  along  the  actual  arrival  angles,  Q(uk)  =  0,  k  =  1,  2, •  •  •  ,K,  (26)  allows  us  to 
conclude  that  within  the  above  approximation, 

*2K)=  0  ;  k  =  1,  2, •  •  •  ,  AT  (27) 

i.e.,  in  all  multiple  target  situations,  where  the  conventional  MUSIC  scheme  is  applica¬ 
ble,  the  variance  of  the  estimator  in  (21)  along  the  true  arrival  angles  is  zero  within  a 
first-order  approximation.  Although  at  first  this  conclusion  does  not  seem  to  agree 
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with  the  results  of  Kaveh  et  aL  ,  for  a  two-source  case  (See  (30)  in  [13]),  an  algebraic 
manipulation  shows  that  within  the  above  approximation,  their  Var0( uk))  =  0, 
agreeing  with  this  result. 

The  general  expressions  for  bias  and  variance  in  (22)  and  (25)  can  be  used  to 
determine  the  required  sample  size  for  a  certain  performance  level  or  to  arrive  at  use¬ 
ful  resolution  criteria  for  the  forward-only  or  the  f/b  smoothing  schemes.  Though  the 
general  cases  are  often  intractable,  a  complete  analysis  is  possible  for  the  f/b  scheme 
with  L  =  1,  which  of  course  can  decorrelate  and  resolve  two  coherent  sources.  As 
shown  in  the  next  section,  this  case  leads  to  some  interesting  results,  including  the 
resolution  threshold  for  two  completely  coherent  equipowered  sources  in  white  noise. 

2.2.3.B  Two-Source  Case 

Consider  the  special  case,  where  the  two  sources  present  in  the  scene  are  com¬ 
pletely  coherent  with  each  other.  In  that  situation,  the  array  output  data  together  with 
its  complex  conjugated  backward  version  x^n)  ;  n  =  1,  2,  •  •  •  ,  N ,  (f/b  smoothing 
with  L  =  1)  can  be  used  to  decorrelate  the  incoming  signals,  thereby  making  it  possi¬ 
ble  to  estimate  their  arrival  angles.  For  two  equipowered  sources,  the  bias  and  vari¬ 
ance  of  the  associated  sample  estimator  can  be  computed  by  using  (A.20)  in  (22)  and 
(25),  respectively.  After  a  series  of  algebraic  manipulations  for  mean  value  of  the  esti¬ 
mator  we  have 

A  a 2 

E(CM]  =  !2(w)+  — : - f(M  -  2)  -(?(“')]  ♦o(A).CS) 

'-'(W)  s" 

Let  ri(ui)  and  r^w)  denote  the  bias  in  the  f/b  smoothing  scheme  and  the  conventional 
MUSIC  scheme.  Then  from  (28) 

6M  =£[$( u/)]  -  Q(u) 

I  2  \ 

=  2NZ  - ! - |(Af  -2)|^M|2-(?L')U(l/r,  C-)) 

«-i  (A  -a1)2 
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and  from  (24)  with  K  =  2  we  have 
A  a 2 

»(w)  =  77  E  - '  77  [(M  -  2)  1^/aMI2  -  Q(a,)]  +  o (1/W2) .  (30) 

,=1  (\  -°) 

To  evaluate  variance,  let  denote  a  typical  term  in  (25).  Then 

2  2  2  2  2  M  M 

°  (w)  =  77  (^1122  +  ^1221  +  Q 2112  +  ^ 2211  ^  +  Jj  E  E  E  E  fytt  • 

«  -1  j  -1  *  -3  /-3 

Using  (A.20)  it  is  easy  to  show  that  the  terms  within  the  first  parentheses  add  up  to 
zero,  and  by  repeated  use  of  (A.20)  over  the  remaining  terms  it  can  be  shown  that 

2  1  ^  V2  ,  .f  ,  . 

o  M  =  Tr  E  I - “  [  I  4®<*) ! 

<  - 1  (A  -ff)‘ 

4-1 

. 

2 Q (w)  2  \a‘ 

=  — v7~  V  - - rr  1 0,  *(»’)  I  *  *■  o  ( l/,V‘ ) .  CM! 

S  ,-t  (A  -<tT 

>  * 

Again  fr‘(.k[)  -  =  0  m  this  case  also.  Notice  that  bias  in  (2‘*»  and  (30j  for  ihc 

f  b  smoothing  scheme  with  L  =  J  and  the  conventional  MUSK  scheme  u-iih  K  -  2 
are  functionally  identical  except  for  a  multiplication  factor  of  two  m  the  convene  »n;tl 
case  Moreover,  these  results  suggest  that  in  a  correlated  two  source  case,  the  f  'h 
scheme  will  perform  superior  to  the  conventional  one  This  can  he  easils  illustrated  m 
an  uncorrelated  scene  where  equality  of  the  array  output  covariance  matrices  m  the 
smoothed  and  conventional  cases  implies  A  =  A  .  0  -  0  .  /  =  1.  2.  •  -  -  .  \f  and  I  , 

-  (A  A  2 ) ( <U  f  *  0  7  flt  )  Substituting  these  values  in  (22)  and  (25).  it  easily 

follows  that  ntv)  =  2  and  -  er‘(*-)  ami  consequently,  the  f/h  scheme  is  uni¬ 

formly  superior  to  the  comertional  one  However,  in  a  correlated  scene,  although  the 
effective  correlation  coefficient  reduces  in  magnitude  after  smoothi  ng,  u  is  difficult  to 
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exhibit  such  uniform  superior  behavior  explicitly.  Nevertheless,  certain  clarifications 
are  possible.  To  see  ihis,  consider  two  cases,  the  first  one  consisting  of  two  correlated 
sources  with  correlation  coefficient  pQ  and  the  second  one  consisting  of  two  coherent 
sources.  In  both  cases,  the  sources  are  of  equal  power  and  have  the  same  arrival 
angles  0{  and  $2.  The  correlated  case  can  be  resolved  using  the  conventional  MUSIC 
scheme,  and  the  coherent  scene  can  be  decorrelated  and  resolved  using  the  f/b 
smoothing  scheme  with  L  =  1.  In  the  later  case  from  (B.2)  and  in  particular  from 
(B.9),  smoothing  results  in  an  effective  correlation  coefficient  pt  =  exp(/(M  - 
l)ca(/)cos(Af  -  l)ud  with  ud  =  ir  (cos&l  -  cos02)/2,  between  the  sources.  In  the 
event  when  the  temporal  correlation  po  in  the  conventional  case  is  equal  to  the  above 
p( ,  then  R  =  R,  A(.  =  A. ;  /?  =  0i  ,i  =1,  2;  and  from  (26),  (29)  -  (31)  the  f/b  scheme  is 
uniformly  superior  to  the  conventional  one  in  terms  of  bias.  This  conclusion  is  also 
supported  by  simulation  results  presented  in  Fig.  1  with  details  as  indicated  there. 

As  one  would  expect,  for  closely  spaced  sources  the  performance  of  the  conven¬ 
tional  scheme  in  an  uncorrelated  source  scene  is  superior  to  that  of  the  f/b  scheme  in 
a  coherent  scene.  This  is  to  be  expected  because  for  small  values  of  angular  separa¬ 
tion  (A2  <  1)  from  (B.28)  and  (B.29),  we  have  r/(w • )  <  f){ui ),/  =  1,  2.  The  deviation  of 
t?(cj.  )  and  fj(uj )  from  zero  -  their  nominal  value  -  suggests  the  loss  in  resolution  for  the 
respective  estimators.  Within  a  first-order  approximation,  since  the  estimators  have 
zero  variance  along  the  two  arrival  angles  in  both  cases,  for  a  fixed  number  of  samples 
a  threshold  in  terms  of  SNR  exists  below  which  the  two  nulls  corresponding  to  the  true 
arrival  angles  are  no  longer  identifiable.  This  has  led  to  the  definition  of  the  resolu¬ 
tion  threshold  for  two  closely  spaced  sources  as  that  value  of  SNR  at  which  [13] 

£[£(«,)]  =  E[0(u>2)]  =£[£((«,  +Wj)/2)],  (32) 

whenever  Var(Q(ui }))  ~  Var(@(u>2))  ~0  .  In  the  case  of  the  two  equipowered 
uncorrelated  sources  equating  (B.28)  and  (B.30),  Kaveh  et  al.  found  the  resolution 
threshold  to  be  [13] 
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ANGULAR  SEPARATION 

Fig.  1  Bias  at  one  of  the  arrival  angles  vs.  angular  separation  for  two  equipowered 
sources  in  uncorrelated,  correlated  and  coherent  scenes.  A  ten  element  array  is  used 
to  collect  signal  in  all  these  cases.  Input  SNR  is  taken  to  be  lOdB  and  number  of 
simulations  in  each  case  is  30. 
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N 
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The  corresponding  threshold  £  in  the  coherent  case  can  be  found  by  equating  (B.29) 
and  (B.31).  In  that  case,  after  some  algebraic  manipulations  we  have 
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Though  £  and  possess  similar  features,  for  small  arrays  the  resolution  threshold  in 
the  coherent  case  can  be  substantially  larger  than  that  in  the  uncorrelated  case.  This 
asymptotic  analysis  is  also  found  to  be  in  agreement  with  the  results  obtained  by 
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Monte  Carlo  simulations.  A  typical  case  study  is  reported  in  Table  1.  When  the 
equality  in  (32)  is  true,  the  probability  of  resolution  was  found  to  range  from  0.33  to 
0.5  in  both  cases  there.  This  in  turn  implies  that  the  above  analysis  should  give  an 
approximate  threshold  in  terms  of  £  for  the  0.33  to  0.5  probability  of  resolution  region. 
Comparisons  are  carried  out  in  Fig.  2  using  (33),  (34)  and  simulation  results  from 
Table  1  for  0.33  to  0.5  probability  of  resolution.  Fig.  3  show  a  similar  comparison  for 
yet  another  array  length.  In  all  these  cases  the  close  agreement  between  the  theory 
and  simulation  results  is  clearly  evident. 

The  above  range  (0.33  to  0.5)  for  the  probability  of  resolution  can  be  explained 
by  reexamining  the  arguments  used  in  deriving  the  resolution  thresholds  (33)  and  (34). 
In  fact,  (32)  has  been  justified  by  observing  that  within  a  first-order  approximation, 
Var(Q (wj))  =  For(^(w2))  =  0.  Although  Var(@((ujl+uj2)/ 2))  is  equally  important 
in  that  analysis,  it  is  nevertheless  nonzero  (see  B.32  and  B.33).  This  implies  that 
though  and  £  satisfies  (32),  in  an  actual  set  of  trials  the  estimated  mean  value  of 
Q((w1+w2)/2)  will  almost  always  be  in  the  interval  (0,  2£[Q((w1+w2)/2)])  and 
clearly  resolution  of  the  two  nulls  in  @  (u)  is  possible  only  if  this  mean  estimate  lies  in 
the  upper  half  of  the  above  interval.  In  the  special  case  of  a  symmetrical  density  func¬ 
tion  for  the  mean  value  estimate,  this  occurs  with  probability  0.5  and  the  observed 
range  may  be  attributed  to  the  skewed  nature  of  the  actual  probability  density  func¬ 
tion. 

IV.  Conclusions 

The  asymptotic  analysis  of  a  set  of  high  resolution  estimators  for  resolving  plane 
waves  that  are  correlated  or  coherent  with  one  another  is  presented  here.  A 
forward/backward  spatial  smoothing  scheme  that  decorrelates  coherent  arrivals  is 
treated  first  for  its  mean  and  variance;  similar  expressions  for  the  forward-only 
smoothing  scheme  and  the  unsmoothed  conventional  MUSIC  scheme  are  derived  as 
special  cases  of  this  general  analysis.  In  particular,  the  variance  of  the  conventional 
MUSIC  estimator  along  the  true  arrival  angles  is  shown  to  be  zero  within  a  first-order 
approximation.  This  result  is  independent  of  the  total  number  of  sources  present  in 
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Table  1 

Resolution  threshold  and  probability  of  resolution  vs.  angular  separation  for  two 
equipowered  sources  in  an  uncorrelated  scene,  (number  or  sensors  =  7,  number  of 
snapshots  =  100,  number  of  simulations  =  100).  Probability  of  Resolution  =  Total 
number  of  successes  in  100  simulations/ 100. 
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the  scene.  Further,  a  resolution  threshold,  which  depends  on  the  relative  angular 
separation,  number  of  sensors,  number  of  snapshots  and  signal-to-noise  ratios,  for  two 
coherent,  equipowered,  closely  spaced  signals  is  derived  from  the  bias  and  variance 
expressions  of  the  f/b  smoothing  scheme.  This  large  sample  based  asymptotic  result  is 
compared  to  the  one  obtained  by  Kaveh  et  aL  [13]  for  two  uncorrelated,  equipowered, 
closely  spaced  signals.  From  these  comparisons,  to  detect  the  arrival  angles  for  two 
closely  spaced,  equipowered,  coherent  signals,  under  identical  conditions  approxi¬ 
mately  [{\/Mudf-\]  times  additional  snapshots  than  those  in  an  uncorrelated  situa¬ 
tion  are  required.  These  results  are  also  seen  to  closely  agree  with  those  obtained 
from  Monte  Carlo  simulations. 
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Fig.  2  Resolution  threshold  vs  angular  separation  for  two  equipowered  sources  in 
coherent  and  uncorrelated  scenes.  A  seven  element  array  is  used  to  receive  signals  in 
both  cases. 
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Fig.  3  Resolution  threshold  vs.  angular  separation  for  two  equipowered  sources  in 
coherent  and  uncorrelated  scenes.  A  fifteen  element  array  is  used  to  receive  signals  in 
both  cases. 
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Appendix  A 

Asymptotic  Distribution  of  the  Sample  Eigenvalues  and  Eigenvectors  Correspond¬ 
ing  to  Distinct  Eigenvalues  of  R 

With  symbols  as  defined  in  the  text,  S  representing  the  ML  estimate  of  the 
forward/backward  (f/b)  smoothed  covariance  matrix  R,  we  have 

R  -  2Z;  S  (r/  +  R,6)  -  BAB*  (A.l) 


S  =  TTT 


where 


2 L  £ 
/  =1 


{ *f(n ) (*/ (n ))f  +  V (» ) (*?(« ))t] 


n  =1 


=  ELE! 


(A.2) 


®  [^i»  ^2’  "  ’  ’  »  Pm  ]  *  [®i>  '  ’  ‘  »  ] 


A  =  diag  [Aj,  •  *  * ,  A^,  a2,  *  ■  • ,  a2]  ,  L  =  rf/ag  [/ /2,  •  •  •  ,  lK,  lK  +  l,  •  •  •  ,  lM 


BBf  =  EE1  =  \M 

and  B,  E  satisfies  Pii,eii  >0 ,i  =  1,  ,2,  •••  ,M  for  uniqueness.  As  is  well  known,  the 
eigenvectors  are  not  unique,  and  let  C  represent  yet  another  set  of  eigenvectors  for  S, 
i.e., 

S  =  CLCf  (A.3) 

where 

C  =  ^Cj,  c2»  ’  ’ ' »  cm  ]  »  =  *  (A-4) 

For  reasons  that  will  become  apparent  later,  C  is  made  unique  here  by  requiring  that 
all  diagonal  elements  of  Y  given  by 

Y  =  BfC  (A.5) 

are  positive  (y<v  >0,  /  =  1, 2,  *  •  •  ,  M).  In  what  follows  we  first  derive  the  asymptotic 
distribution  of  the  set  of  sample  eigenvectors  and  eigenvalues  of  S  given  by  (A.3)  - 
(A.5)  and  use  this  to  analyze  the  performance  of  the  sample  directions  of  arrival  esti¬ 
mator  @(u>)  in  (21).  This  is  made  possible  by  noticing  that  although  the  estimated 
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eigenvectors  ev  e2,  •  •  • ,  eK,  in  (21)  are  structually  similar  to  their  counterparts 
Pv  fi2,  ••  • ,  0K,  and  in  particular  have  eu  >0,  nevertheless  they  are  also  related  to 
c( ,  i  =  1,  2,  •  •  • ,  K,  through  a  phase  f  actor  i.e., 

i  =1,2,  -.K  (A.6) 

and  hence 

(2(<x)  - 1  -  E  I «/»(“) 1 2  - 1  -  E  \cl - 1  -  E  yM  (A-7) 

i-l  i-1  i -1 

y,  (w)  =  |c/a(u;)|2.  (A-8) 


Thus,  the  statistical  properties  of  $(u>)  can  be  completely  specified  by  those  of 
c.,i  =  1,  2,  •  •  •  ,  K,  and  towards  this  purpose,  let 


i 

II 

b 

(A.9) 

and 

G  =  [gv  g2,  *  • ' ,  gK>  -  *  •  •  gjv/  1  =  'fit  (C  -  B) 

(A.  10) 

T  =  B!SB  =  B^LdB  =  YLYf 

(A.  11) 

where  Y  is  as  defined  in  (A.5)  with  yu  >0,  i  =  1, 2,  *  •  • ,  M.  Further,  let 

i 

H 

II 

with 


1 

y/N 


N 

E 

n  =1 


2Z;  E  ( : z/(* )  (z! (n  ))f  +  z/ (* )  (z/b (« ))f )  -  a 

/ =i 


(A.  12) 


z/(n)  =  Btx/(n)  ~N(0,BfR/ B)  ;  zfa )  =  )  -  AT  (0,  B^  B)  .(A.13) 

It  is  easily  verified  that  these  random  vectors  preserve  the  circular  Gaussian  property 
of  the  data  vectors.  Again,  from  the  independence  of  observations,  asymptotically 
every  entry  in  U  is  a  sum  of  a  large  number  of  independent  random  variables.  Using 


(4)  From  (A.2)  and  (A.3)  we  have^V  =  VL  where  V  =  EfC.  Thus,  for  any  nonrepeating 
eigenvalue  /*,  it  follows  that  =  e  c(  .  Interestingly,  since  the  eigenvalues  of  the  estimated 
covariance  matrix  arc  always  distinct  with  probability  one  [18],  (A.6)  is  true  for  l<i  <M . 
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the  multivariate  central  limit  theorem  [16],  the  limiting  distribution  of  U  tends  to  be 
normal  with  means  and  covariances  given  by 


E[U»'-WZE 


J_  - 

2 L 


E  [4m )ztj  *(« ) + ziM )zij  *(«))  -  \ 6ij 


=  0  (A.  14) 


(Here  onwards  whenever  there  is  no  confusion,  we  will  suppress  the  time  index  n) 
since 


2 Tpi  +zU4j)  ) 


_l_  L 
2L 


E  (x/(x/)t  +  x/(xf)t) 


/-I 


*1 


-f-El S]0j  -tfoj 


(A.15) 


and 


E  K jUkl  ]slS  I  ~nj  E  E  j  £  Wpi^pj  Zqk  Zql  ]  +  £  [ZpizJpj  ZqkZql  1 

n  =1  L  ^  p  =1  q  =1  k 


ILL 


/  J'J'J 


f  f  *  6  *  b 

TJ  TJ  “T  -V 


p=l  q 


+  E  [ ZpiZpj  Zqk  Zql  ]  +  E  [ ZpiZpj  Zqk  Zq^) 


\\8ij6kl 


Using  the  results  ^  for  fourth-order  moments  of  jointly  circular  Gaussian  random 
variables  and  after  some  algebraic  manipulations,  we  have 

£[“«“«]*  dr  E  E  ( # +  # <  K  i>',  K  f>, 


p  =i  q  =i 


+  tWnMKA +  =  4,  •  (A.i6) 


Here  by  definition po  =  Mo  -M  -p  +  2,  <7o  =  A/o  -M  -q  +2  and  7.  is  the  inverted  /?* 
vector  with  -7 f.  m  =  P*  M.m  +1.  For  L  =  1,  in  an  uncorrelated  as  well  as  a  two  equi- 
powered  coherent  source  scene,  it  is  easy  to  show  that  pjRPj  =  ijR-ij  for  all 
Using  standard  results  regarding  the  equivalence  of  eigenvector  sets  of  a  hermitian 


(5)  Let  z ,,  z2,  z3,  z4  be  jointly  circular  Gaussian  random  variables  with  zero  mean.  Then  [15] 
E  lziztt*\  -=  E\zx zi  \E[Z*\  1  +  E\ziz\  1  E\z*i  1- 
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matrix  (see  footnote  (4)),  it  then  follows  that  7,  =  eJ  *  =  1,  2,  •  •  • ,  K  and 
[%  + 1,  where  v  is  an  (M  -K)x(M  -K)  unitary 

matrix.  Further, 


R/,  I^)']  ;  R^  4 S (A.  17) 

In  obtaining  (A.  16),  we  have  also  made  use  of  (A.  15)  and  the  fact  that  for  circular 
Gaussian  data. 


*(**« 


f  -rb  *1  -  t 


St 


]  =  0!E[x'x°']0j  =  0/E[x/(x£)rb;  =  0,  p,q  -  1-.E 


The  forward-only  smoothing  scheme  now  follows  as  a  subclass  of  this  general 
analysis.  In  that  case  the  estimate  of  the  smoothed  covariance  matrix  is  given  by 


f  1  ^ 

s  =rs 

/  =  1 


1  N  f  ,  , 

Tv  E  x/('l)(x/(n))t 


=  E/L/E/ 


Then,  as  in  (A.  14)  with  zf^n)  =  where  £  [S^]  =  = 

M  t 

£  A/;  Pfi  Pfi'  we  have 


L 


L 

E 

/-1 


ZV 

zli  zlj 


-  w 


Thus,  E  [u^  ]  =  0  and 

E  "  jj  £  E  £/,  R/,  Pfk  Pf,  K  Pfi  -  rLj  (A-18) 

p  =1  9=1 

where  we  have  again  made  use  of  the  circular  Gaussian  property  of  the  data  vectors. 

Two  important  special  cases  of  considerable  practical  interest  are  the  conven¬ 
tional  (unsmoothed)  MUSIC  scheme  and  the  f/b  smoothed  scheme  with  L  =1.  Of 
these,  the  former  one  corresponds  to  the  forward-only  scheme  with  L  =  1,  and  in  that 
case  from  (A.  18), 


TMi-Pl*PkPl*Pj  -w*v 


(A.19) 
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In  the  latter  case,  using  (A,  17)  together  with  the  identity  =  0  for 

i  =  K  + 1,  K  +2,  •  •  • ,  M  and  k  =  1, 2,  ■  •  • , K  simplifies  (A.16)  into 

in  an  uncorrelated  scene.  Similarly,  in  a  two  equipowered  coherent  source  scene,  we 
also  have 


-  'eKintfA  -  tKwXA  ]  •  iJM< 2 

\\  A  ( &ik  6ji  +  ijflk  ) ,  otherwise . 


(A.20) 


Further,  using  (A.  11)  together  with  (A.  12)  and  (A. 9)  we  have 

T=i+^u=YtY,=Y(i+ wF)Y' 

which  gives  the  useful  identity 

A+^U=Y(A+^F)Y'.  (A.21) 

To  derive  the  asymptotic  properties  of  the  sample  estimates  corresponding  to  the  dis¬ 
tinct  eigenvalues  AJt  X2,  -  •  •  ,XK  of  R,  following  [16,  19]  we  partition  the  matrices  A,  U, 
F  and  Y  as  follows 

-u„  u12 
u  = 

,U21 


(A.22) 


Here  A1(  Un,  F1  and  Yn  are  of  sizes  KxK,  etc.  With  (A.22)  in  (A.21)  and  after  some 
algebraic  manipulations  and  retaining  only  those  terms  of  order  less  than  or  equal  to 
\/Vn  ,  we  have 


O 


Uu  U12- 


o  a  I, 


U21  U22J  O  0^22  Y^ 


*iwn 


•WnAt  o^WuYjj- 


O 


o  y22f2y^. 


'  W21  Aj 


/  1  ^ 

+  o(^) 


(A.  23) 


where 


w11=v77(y11-ik) 


(A.24) 


wi2  =  Y12  ,  w21  =  y/N  Y21 

and  define  the  column  vectors  wp  w2,  •  •  • ,  w K  from 


*11 

=  [w1,w2/-,wJf]=W. 


Similarly, 


YY^  =  I  = 
11  lM 


W  W  Y' 
tt12  *22 


O  Y^Y^J 

r  K  K 


Y22Wi2  0 


+  0(T7). 


(A.25) 


Thus,  asymptotically  for  sufficiently  large  Ar,  from  (A.25)  and  (A.23)  we  have 


O  =  VVn  +  w[, 


(A.26) 
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W21  +  =  O 

un  =wii^  +  Fi  +iiwifi  (A-27) 

and 

U2,  =  W21  A,  +  t2  Yh  W>2  =  W21  A,  -  a1  W21 .  (A.28) 

Since  yu  >  0,  this  together  with  (A.24)  and  (A.26)  implies 

wa  -  o  ,  i  =  i,  2,  *  -  • ,  a: 

and 

w‘j  =  "w;/  »  =IZ“-  ,K  ,  i  7*7 

which  when  substituted  into  (A.27)  -  (A.28)  gives 


J 

■7=U,  ,  /-l,*-.* 

(A.29) 

i,j=l,2,---,K  ,  i  fj 

vv,;  =  • 

“ij/Hj-o1) 

i  =  K  +  l,K+2,---  ,M  ,  j  =  1,2,  -  ••  ,K  . 

(A.30) 

This  together  with  (A.9)  and  (A.29)  gives 

1]  =  A,.  +  (\/VN  )/..  =  A.  +  (l/v'W  )«..  ;  i  *  1,  2,  •  •  •  ,  K  (A.31) 

and 

c,  =  0.  +  (l/\/5V)Bw,.  +(l/>/JV)S  Wjjj  ;*  =  1,2, •••,£.  (A.32) 

it' 

Thus,  the  estimators  /,  and  c,  =  1,  2,  •  *  *  ,  AT,  corresponding  to  the  distinct  eigen¬ 
values  of  R,  are  asymptotically  multivariate  Gaussian  random  variables/vectors  with 
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mean  values  A(  and  /?  ,  i  *  1, 2,  •  •  • ,  K,  respectively.  Further, 

Cot =  jf E ( u*  -  77  .  i,j  -  1.2.  -.K  (AJ3) 


1  M  M  lklji 

CoH c.,c  )  =  77  E  E  - — — — — 

(\  -aa)(a  -  a,) 

kf“  If J  J 


Kti- 


(A.34) 


Notice  that  c(  in  (A.32)  are  not  normalized  vectors,  and  it  may  be  emphasized  that  in 
the  case  of  eigenvectors,  the  above  asymptotic  joint  Gaussian  property  only  holds  good 
for  these  specific  sets  of  unnormalized  sample  estimators.  However,  from  (A.4)  since 
the  eigenvectors  c(  ,  /  =  1, 2,  •  •  • ,  K,  appearing  in  (A.7)  are  normalized  ones,  to  make 
use  of  the  explicit  forms  given  by  (A.32)  there,  we  proceed  to  normalize  these  vectors. 


Starting  from  (A.32),  we  have 


•J  A  1  Af  >y 

—  —  1  4-  ~ "  X  1  I  til  I 


lie,  ||  =  c/c,  =  1  +  77  E  l">l  >  1 

y-i 

and,  hence,  the  corresponding  normalized  eigenvectors  c.  ,  i  =  1,  2,  •  •  •  ,  K  have  the 


a  i  (  l  Af  ,'1  .  i  at 

£.  -  Ik-  Is  =  1-wE  K,l2  MvfEV, 

;-l  V,V  y.l 


'iivTFS  E  K-lSA  +o(i/w2). 

ViV  *=1  /=1 

kfi  I  fit 

Using  (A.30)  and  (A.  16)  this  gives 

1  M  ^iiji  _  j 

E[tt  1  =  fit  ~  2N  E  - 7 fit  +o(l/N2)  ;  i  =  1,2,  •  ■  •  ,K  (A.35) 

7  )**  / 

since  from  the  asymptotic  joint  normal  distribution  of  these  zero-mean  random  vari¬ 
ables  uij  (/  jty),  their  odd-order  moments  are  zero.  Thus,  asymptotically  these  nor¬ 
malized  estimates  for  the  eigenvectors  0V  02,  ,  PK,  of  R  are  unbiased  and  the 

exact  bias  expressions  are  given  by  (A.35).  Further, 


1 


7% 


E  *  E  wkjWk 

A  -1  * -1 

*fi  kfij 


\  M  M  .♦ 

+  77  £  E  whwi,0kP, 

* -i /-i 
A  f  I  /  f  j 


2N\fN 


M  M 

E  E 

A  -1  /  -1 
Afi  />*/' 


lV$ 


W  M 

+  E  E 

A -1 /-I 
A/*;'  ifj 


\w, 


A  j  1  Wtj 


'Ati 


M  M 


+  E  E  "feKylV/*  E  E  KlSfc# 

A  =1  /-I  A-l  /-I 

A^i  //■;'  A^»  tfj 


+  o{\/N2).  (A.36) 


Again,  neglecting  terms  of  order  1/AT  and  proceeding  as  above,  this  expression 
reduces  to 


£[«,«/] 


L  iikk 


M 

E  ~  ~ 

i‘»;i (A.-  -A*> 


A/ 

+  E 


r;;M 


r  \2 


£;} (A;  -A*> 


Kp) 


1  Af  A/ 

+  77E  E  — 

A  =  1  /  =  1  (A. 
A  fi  Itj  * 


^ klji 

\)(\  ~\) 


-Pjl  +  O  (1  /N2) 


(A.37) 


An  easy  verification  shows  that  Cov{ti  ,6.)  is  once  again  given  by  (A.34),  but 
nevertheless,  (A.36)  -  (A.37)  will  turn  out  to  be  useful  in  computing  the  asymptotic 
bias  and  variance  of  the  sample  direction  estimator  @  (u>)  in  (21). 

These  general  expressions  in  (A.35)  -  (A.37)  for  first-  and  second-order  moments 
of  normalized  eigenvector  estimators  can  be  used  to  evaluate  their  counterparts  for 
the  forward-only  and  the  conventional  cases  by  substituting  the  proper  r  values 
derived  in  (A.  18)  and  (A.  19),  respectively.  Thus,  for  the  conventional  MUSIC  case 
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using  (A.  19),  we  have 


£[£,-]  =  4  - 


1  M  , 
2VE  - -P,  +»(1/W2) 

.‘-I  /\  \  \* 


Z;1  (\  -  a jY 

jti  j 


1  f  M  W 


+  +  1  M  I  K  Wl 

E[W]  =  Mj-2N  E  - :  +  E 


M  ^j\ 


;)ft-v 


1  M  W 


+  N  E 


i;}  ft  -v 


A/»l  +  ®  0-W2) 


where  A(.,/?.  ;  i  =1,2,  ••  •  ,M  are  as  defined  in  (8).  These  results  coincide  with 
those  in  [13]  (see  Appendix  A). 

Once  again  for  the  f/b  smoothed  case  using  (A.7)  -  (A.8)  and  recalling  that  the 
eigenvector  estimator  appearing  there  are  normalized  ones,  we  have 


yt  M  =  I  c/ a(w)  | 2  =  at(w)c)c(ta(w) 


(A.38) 


and  from  (A.37)  and  (21)  we  have 


a  -  1  K  M  1  iikk  _  t 

£[<3(w)]-c(«)  + ^  e  s - i/w>r 


At  ,W  r,VW  t  _  .*  , 

E  E  - aW*/»,a(w)  +o  ( 1/A/2)  -*  Q(u)as  N 

(A,  "\)(A  -A,) 

k  fi  I  fit  '  K  '  1 


oo.  (A. 39) 


Also, 


^«3M)-£[<?V)]-(e[<2(w)])  =  £  2  l-£[r,]E[v;])  (A.JO) 


Using  (A.38)  and  (A.36),  after  a  series  of  manipulations,  we  have 
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E[y,yj  1  -Ely,]E[yj]  =  +  O  (1  /N2) 

where 

di  (w)  =  5]  (wfa.af(w)j^£/a(w)  +  £**(")) 

*  =  i 
k?i 

which  gives 


2  Af  A/ 

77  S  E 

*  =  t  /  =1 
k fii  I  ?j 


Re[(fW;vaW^/aM  +  af(w)0A0/a(u;)] 

ft  -\)(A  -A,) 


+  o  ( 


(A-41) 


Finally,  with  (A.41)  in  (A.40)  we  get 

Var(§(u))  = 

E  £  £ - : — — — : - 

I  -  1  ;  -  t  k  -  l  /  -  1  (A  -  Xk  )  (A  -  Xt ) 

kfii  Ifij  1 


+  o  (1/A/2)  -  0  as  N  -*  oo.  (A.42) 

Thus  (3(w)  is  a  consistent  estimator  in  all  cases. 

Appendix  B 

In  this  appendix,  expressions  for  eigenvalues  and  eigenvectors  of  the  smoothed 
covariance  matrix  R  with  L  -  1  for  two  coherent  signals  are  derived.  In  addition, 
several  associated  inner  products  that  are  needed  in  section  2.2.3. B  for  resolution  per¬ 
formance  evaluation  are  also  developed  [20J. 

Consider  two  coherent  sources  a,M(/)  and  a^i{t)  with  arrival  angles  0,,  02  and 


source  covariance  matrix 
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\  ,l°^2  =  k  “2*1  W  ’  ai  =  \ai\eJ*‘  ’  £[lu(0|2]  =  l. 
L«2«i  Kl  la2J 

When  the  forward/backward  smoothing  scheme  is  deployed  once  to  decorrelate  the 
coherent  signals,  from  (15)  the  resulting  source  covariance  matrix  Rw  has  the  form 


r  -  AL«t  +  wl  -  f  K|2  “‘^'l  -  A,__, 

R„  -  [aa  +  TfT  J  -  -  [a~f]  t 

Z  La^jP,  IQ^  |  z  LVJ 


where 


,  .  .,7  y  (AT  -  IV,  j(M-  l)wj 

7  =  (^aj  i/^J  ,^2  =  e 


and  the  effective  correlation  coefficient  p(  is  given  by 


P'=(l+e  W)/2 


(B.l) 


(B.2) 


Using  (B.l),  the  noiseless  part  of  the  smoothed  covariance  matrix  R  can  be  written  as 


R  4*^*1  =  ![»>, b’  +  bjbJ) 


(B.3) 


where 


b,  =  VXf  (o^afov,)  +  a,a(w2))  ;  b2  =  n/A/  (i^a^u/,)  +  a(u>2)).  (B.4) 

The  nonzero  eigenvalues  of  R  are  given  by  the  roots  of  the  quadratic  equation 


P2  -tr(  ARU  A!)p  +  |RU  ArA|  =  0 


which  gives 


)i,  =  yMARuAf)  1  1  1  - 


|R„A  A 


[/r(AR„A')/2] 


;  1=1.2.  (B.5) 


To  evaluate  pv  p^  explicitly,  we  define  the  spatial  correlation  coefficient  ps  between 


the  sources  to  be 


,,  sinA/u;,  .... 

Ps  =  a(w,)  a(w2)  =  e  -  =e  Si(Mud) 

h1  sinw. 


(B.6) 
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with  ud  =  ( Wj  -  w2  )/2 .  From  (B.3)  -  (B.4)  we  have 

*r  ( ARU  )  =  M  ( |aj2  +  laj2  +  Re(  o^p,  + 

(B.7) 

and 

|R„a'a|  -  |R„|  |a'a|  =  M2|a1|2|a2|2(l  -  |  p,  |2)(1  -  \ps  |2). 

(B.8) 

1  Here  onwards  we  consider  the  two  sources  to  be  perfectly  coherent  and  of  equal 

2 

power;  i.e.,  Oj  =  ctj  and  |  cq  |  =  1.  In  that  case  we  have 

P,  -  2  ~e  cos  (M  - 1)  Ud 

(B.9) 

Re(p5 )  =  cos[ (M  -  l)ud  ]  Si (M ud )  =  Re(psp,*) 

(B.10) 

and  with  (B.7)  -  (B.8)  in  (B.5)  it  is  easy  to  see  that 

£,  =  M  [l  +  Re( Ps P* )  ±  1  Ps  +  P,  1  ]  i  =  1.  2 , 

(B.ll) 

2  2  2 

where  we  have  made  use  of  the  identity  [Re(p5p(*)]  =  |  ps  |  |  p,  |  .  The  eigenvec- 

tors  corresponding  to  these  eigenvalues  span  the  two-dimensional  signal  subspace,  and 

from  (B.3)  they  are  linear  combinations  of  bj  and  b2;  i.e., 

pi  oc  (bj  +  k .  b2)  ,  i  =  1,  2 . 

(B.12) 

Moreover,  /2. ,  ,  /  =  1,  2,  as  a  pair  satisfy 

(  ar„  =H  ,  i  =  1,2, 

which  together  with  (B.3)  results  in 

y [ bjbj  +  A-.bf^lbj  +  y [bjbj  +  *,b2fb2]b2  =  ^bj  +  ^b2>  i  =  1,2. 

(B.13) 

The  solution  to  (B.13)  need  not  be  unique.  However  since  the  eigenvectors  can  be 

made  unique  by  proper  normalization,  at  this  stage  we  seek  a  solution  set  to  the  dis- 

tinct  equations 

ytbjbj  +  ki b|b2 ]  =  ;  y[b]bj  +  *f.bjb2]  =  ,  *  =  1.  2. 

(B.14) 
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Clearly,  solutions  to  (B.14),  if  they  exist,  satisfy  (B.13).  To  simplify  k{  ;  / 
further,  using  (B.4)  and  (B.10),  notice  that 

bfbj  =  2M  ( 1  +  ReO.,V)) 


b[b2  =  2 a['M  i/,( p'  +  p")  =  2a~'M  u2(ps  +  pt  ) 


and  these  together  with  (B.ll)  in  (B.14)  yield 


k;  =  ± 


I  Ps  +  P t\ 


I  Ps  +  Pt  I 


«T  VM  +  Pt)  °*\vi  +  Pt) 

Using  (B.15),  the  eigenvectors  in  (B.12)  can  be  written  as 

A  oc(b1  +  kj b2 )  =  (a{  +  af^k;  )a(w1)  +  (a  +  ct[u2k.  )a(w2) 


(B.15) 


I  Ps  +  P,  I  I  Ps  +  Pt  I  ' 

a  1  ±  -  a(^i)  +  1  ±  -  a(w2)  ■ 

p*  +  P*  Ps  +  Pt 


(B.16) 


To  simplify  this  further  observe  that 


Ps  +Pt  =e 


K.M-  IK 


cos  (M  -  l)wd  +  5/  (Mud  )  j 


and  consider  the  case  when  [  cos  (Af  -  1)  wd  +  Si  (Mwd )  ]  >  0.  Then  from  (B.16) 

-  y(Af  -lVi/2  [  -KM-1W2  -;'(A/-1W2]  ,  x 
P, Ct  e  [e  ±e  J  a(wj) 


KM-\)»Jl\  -j(M-  iyut/2  -KM-  IVj/21 

?  [e  ±  <?  J 


a(w2)  oc  ±  u2 


where 


;(Af-lV,/2 


KM-  1H/2 


/  v—  /  1/  /  \  j  v-  ~r~u  —  /  v 

Uj  =  e  a(a/j)  ,  u2  =  e  a(w2) . 


Finally,  the  normalized  eigenvectors  corresponding  to  the  nonzero  eigenvalues  in 
(B.ll)  are  given  by 
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(»,  ±  u2)/V2(1  ±Si(Mud)) 
(Uj  ?  T  Si(Mud)) 

k 


[  cos  (Af  -  1)  +  Si  (Af  )  ]  >0 

(B.17) 

otherwise 


i  =  1,2. 

Notice  that  the  uncorrelated  source  scene  is  a  special  case  of  (B.l)  with  a,  =  a,  =  1, 
and  pt  =  0.  Thus  from  (B.ll)  in  that  case 


M,  =  A/(l  ±  |pj) 

and  similarly 

(u1  ±  u2)/v/2(  1  ±  Si(Mud))  Si{Mud)  >  0 

p.  =|  , _ 

(ux  +  u2)/'y/2(l  +  Si(Mujd))  otherwise 


(B.18) 


(B.19) 


i  =  1,2. 

From  (B.17)  and  (B.19)  we  can  conclude  that  for  equipowered  sources,  irrespective  of 
their  effective  correlation  pt  resulting  from  spatial  smoothing,  the  smoothed  and  the 
uncorrelated  cases  have  the  same  set  of  eigenvectors  whenever  [  cos  (Af  -  \)ud  + 
Si (Mujd)]  and  Si (Mwd )  have  the  same  sign;  i.e., 


P,  =  Pt  ,  /  =  1,  2  [ cos (M  -  1  )wd  +  Si(Mwd)]  <  0  and  Si (Mud )  <  0 

-  P2  ,  ~ft2  ~  P\  otherwise  . 


We  conclude  this  appendix  with  several  useful  parametric  approximations  to 
eigenvalues  and  inner  products  between  eigenvectors  and  direction  vectors  for  both 
uncorrelated  and  coherent  cases.  To  start  with,  let  [13] 

a2  a  (mV)  /3 

2 

For  closely  spaced  sources  (A/  ud)  <  <  1,  and  in  that  case  from  (B.9)  and  (B.6) 


Pt  =  e 


j (M  -l)wd 


3  .  Af-1  2.2  .  3  ,  A/-1  4.4 

1  "  A  +  T(-ifi-)  A  + 


8 v  M 


and 
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Si(Mud)  =  T7  — 


1  ShlMud  _  1  2  ,  _3_a4, 
V/  •  ~  f1  2A  40 A  J 


_  ;'(A/-l)wrf  _1_  2  3  4 

"r  ~  e  1  -  2 A  +  40 A  • 


(B.20) 


For  the  uncorrelated  case  parametric  expressions  for  the  eigenvalues  can  be  easily 
obtained  from  (B.18)  and  (B.20).  In  a  similar  manner  for  the  coherent  case,  using 


(B.ll)  we  get 


-  ~  a  i  _-L \  a2  ,  /  33_  9  .  4 

Hx  ~  4Af  1  (1  2M^A  +  ^  80  8A/^A 


(B.21) 


(B.22) 


Because  of  the  equivalence  of  eigenvectors  for  two  uncorrelated  and  perfectly 
coherent  equipowered  sources,  we  have  (for  Si  ( Mud )  >  0) 


|#a(w)|2  -  |/f/a(u>)|2  ,  for allw ,  i  =  1,2 


(B.23) 


and  it  suffices  to  obtain  the  inner  products  of  the  eigenvectors  in  (B.19)  with  direction 
vectors  associated  with  the  true  arrival  angles.  A  little  algebra  shows  that 


1  +  Si  (MUj)  a  ~ 

l/f1a((4,)|2  =  itfaM2  =  - 2 - =  1  -  4 A'  +  ^A‘  (B.24) 


1  -  Si(Mud)  a 
|^a(Ul)|2  =  |/?2'a(u2)|2 - 5 - =  4 


=  jA2--^A4.  (B.25) 


Similarly,  for  the  midarrival  angle  wm  =  (w1  +  w2)/2  we  also  have 


2  (Si  (Mu,  /2)y  . 

\(>Wm)\2  =  l^aK)|2  =  *  1  -  Ma4 

1  +  Si(Mud) 


(B.26) 


|^a(w„)|2=  |/?2'aK)|2  =  0. 


Finally,  with  £  =  £  =  PM/o 2  =  M /</,  and  using  (B.21)  -  (B.27)  in  (29)  -  (30),  for  bias 


(B.27) 


we  have 
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M  -  2  1  A"2  ' 

N  [y  +  ^r 


(B.28) 


-/  M  -  2  f  1  f  MA~2  J_)  A~2  2A/A~4 

^  "  AT  |  6(M  -  2)  +  10  +  ^  9(m  -  4) 

for  i  =  1,  2,  and  for  the  midarrival  angle  u  ,  this  is  given  as 


M  A 
30  (M 


-2 


(B.29) 


£[i2K)3  =  fl  +  ^  +^c 


(B.30) 


in  an  uncorrelated  source  scene  and 


£[0<«m)i-<»  +  -M-L4'  +  4* 


in  a  coherent  scene.  Here 


i  i 


a  =  a  =  Q(uj  )  ~  A4/80 , 


(B.31) 


i  _  f  A/  -  2  .  .  f  A/  -  2  . „  .2,,. 

b  ~  2 — (1  +  A/4)  *  c»  — 4 — (l  +  A/2)  , 

v  ✓  \  > 


.-  .  M  -  2  .  _3_  a2  .  -  ...  M  -  2  .  [_  _3_  2  MA" 

6  ~  4  1+1  2A/Aandc~  16  1+2  M  A  ~  45  (M  -  4) 


As  a  consequence  of  the  above  analysis,  we  also  have 


2,  ,  d  1  1 

a  )  =  T7  —  e  +  — r  / 

^  2£  4£2  J 


(B.32) 


.2.  ,  d  1  .  1  - 

*<wm)  =  77  _ e  +  ~~2 / 

*  -4e  16e 


where 


(B.33) 


A4  A4 

,  _  r  _  A_  -  A_ 

d  ~  40  80 


e  ~  1  +  A2/4  +  A4/40  ,  /  ~  1  +  A2/2  +  9A4/80 

e  =  1  +  (1  -  3/2M)  A2  +  (47/80  -  15/8/1/  +  9/4M2)A4 
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/  =  1  +  (2  -  3/M)  A2  +  (87/40  -  27/4M  +  27/4A/2)  A4 
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23  GEESE  (GEneralized  Eigenvalues  utilizing  Signal  subspace 
Eigenvectors  )  -  New  Performance  Results  on  Direction  Finding 

2.3.1  Introduction 

In  recent  times,  multiple  signal  identification  using  multiple  sensor  elements  has 
been  a  topic  of  considerable  research  interest  in  array  signal  processing.  A  variety  of 
high  resolution  techniques  that  evaluate  the  directions-of-arrival  of  incoming  planar 
wavefronts  by  exploiting  certain  eigenstructure  properties  associated  with  the  sensor 
array  output  covariance  matrix  have  been  developed  in  this  context  [1]  —  [11].  Of 
these,  the  relatively  new  scheme  called  ESPRIT  (Estimation  of  Signal  Parameters  via 
Rotational  Invariance  Techniques)  [9] -[10]  departs  from  its  predecessors  on  several 
important  accounts.  It  utilizes  an  underlying  rotational  invariance  among  signal  sub¬ 
spaces  induced  by  subsets  of  an  array  of  sensors.  To  accomplish  this,  in  the  original 
ESPRIT  scheme[9],  the  interelement  covariances  among  the  given  sensors  are  used  to 
construct  the  auto-  and  cross-covariance  matrices  first  and  the  common  noise  variance 
is  then  evaluated  by  an  eigendecomposition  of  the  auto- covariance  matrix.  After  sub¬ 
tracting  the  noise  variance  from  the  proper  elements  of  the  auto-  and  cross-covariance 
matrices,  the  generalized  eigenvalues  of  a  matrix  pencil  formed  from  the  subtracted 
matrices  are  computed  and  they  in  turn  are  shown  to  uniquely  determine  the  unknown 
directions-of-arrival  [9] -[10].  Compared  to  the  Multiple  Signal  Classification 
(MUSIC)  technique  [2],  the  ESPRIT  scheme  is  known  to  reduce  the  computation  and 
storage  costs  dramatically.  In  addition,  this  method  is  also  shown  to  be  more  robust 
with  regard  to  array  imperfections  than  most  of  the  earlier  ones. 

Notwithstanding  these  merits,  when  estimates  of  the  inter-element  covariances 
are  used  in  these  computations,  subtracting  the  estimated  noise  variance  from  the 
auto-  and  cross-covariance  matrices  can  at  times  be  critical  and  may  result  in  overall 
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inferior  results.  To  circumvent  this  difficulty,  the  TLS-ESPRIT  (Total  Least  Squares 
ESPRIT)  scheme  makes  use  of  certain  overlapping  subarray  output-  and  their  cross¬ 
covariance  matrices  simultaneously  [11].  Though  TLS-ESPRIT  is  superior  in  its  per¬ 
formance  compared  to  ESPRIT,  it  is  computationally  much  more  complex.  However, 
computational  simplicity  can  be  maintained  without  sacrificing  superior  performance 
by  exploiting  the  underlying  rotational  invariance  among  signal  subspace  in  an 
efficient  manner.  In  that  respect,  the  GEESE  (GEneralized  Eigenvalues  utilizing  Sig¬ 
nal  Subspace  Eigenvectors)  technique  -  that  is  studied  here  seems  to  be  promising. 
Unfortunately,  unlike  the  MUSIC  scheme  [12],  no  statistical  performance  analysis 
results  are  presently  available  for  the  ESPRIT  or  the  TLS-ESPRIT  scheme  reported 
in  [9]  -  [10]  to  evaluate  their  imperfections. 

In  what  follows,  we  first  derive  this  proposed  scheme  for  estimating  the 
directions-of-arrival  of  multiple  sources.  This  is  carried  out  by  observing  a  well-known 
property  of  the  signal  subspace;  i.e.,  the  subspace  spanned  by  the  true  direction  vec¬ 
tors  is  identically  the  same  as  the  one  spanned  by  the  eigenvectors  corresponding  to 
all,  except  the  smallest  set  of  repeating  eigenvalue  of  the  array  output  covariance 
matrix.  This  elementary  observation  forms  the  basis  for  the  algorithm  described  in 
section  2.3.2.  Using  results  derived  in  appendix  A  [16],  section  2.3.3  presents  a  first- 
order  perturbation  analysis  for  the  case  where  the  covariances  are  estimated  from  the 
data  and  evaluates  the  mean  and  variance  of  the  directions-of-arrival  estimators  for  a 
single-source  scene  and  a  two-source  scene.  These  results  are  in  turn  used  in  deriving 
resolution  thresholds  associated  with  two  closely-spaced  equipowered  sources. 

In  an  uncorrelated  and  identical  sensor  noise  situation,  when  exact  covariances 
are  available,  all  these  techniques  can  be  applied  to  a  uniformly  placed  array  or  a  pair¬ 
wise  matched  arbitrary  array  with  codirectional  sensor  doublets.  Since  functionally 
these  two  arrays  generate  the  same  structured  data  with  respect  to  the  methods  under 
discussion  in  the  exact  case,  we  will  assume  a  uniform  array  to  describe  the  algorithm. 
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2.3.2  Problem  Formulation 

Let  an  uniform  array  consisting  of  M  sensors  receive  signals  from  K  narrowband 
sources  u  l(t),u2(t),  •  •  •  ,UK(t),  which  are  at  most  partially  correlated.  Further, 
the  respective  arrival  angles  are  assumed  to  be  6 j,  02,  ’  ’  '  ,  Og  with  respect  to  the 
line  of  the  array.  Using  complex  signal  representation,  the  received  signal  x ■  (t )  at 
the  ith  sensor  can  be  expressed  as 


K 

*i  (' )  =  E 

k  =  1 


U, 


( Oe 


-jx(i  -  l)cos0A 


(1) 


Here  the  interelement  distance  is  taken  to  be  half  the  wavelength  common  to  all  sig¬ 
nals  and  n-  (t )  represents  the  additive  noise  at  the  sensor.  It  is  assumed  that  the 
signals  and  noises  are  stationary,  zero-mean  circular  Gaussian  independent  random 

processes,  and  further  the  noises  are  assumed  to  be  independent  and  identical 

2 

between  themselves  with  common  variance  cr  .  Rewriting  (1)  in  common  vector  nota¬ 
tion  and  with  u>k  =  ttcos 0k  ;  k  =  1,  2,  • 4  *  ,^T,wehave 

x(t)=y/M  £  uk(t)a(uJk)  +  n(t),  (2) 

k  =  1 

where  x(  t )  is  the  M xl  vector 

T 

x(0  =  j*i(0>*2(r)’ '  "  ’  (3) 

and  )  is  the  normalized  direction  vector  associated  with  the  arrival  angle  9k ;  i.e., 

,  v  i  r.  -i  -2  -(M-i)ir  ... 

aH>"  vm  J’  (4) 


with 


% 


JUk 


=  e 


(5) 
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The  array  output  vector  x(t)  can  further  be  rewritten  as v 

x(f)=Au(r)  +  n(/),  (6) 

where 

T 

u(0  =  •”.%( 0]  (7) 

n(0  =  [/ii(/),«2(0,  •”  ,«M(0]  (8) 

and 

A  =  \fM  Ja(wj),  a(w2),  •  •  • ,  a(w^)j.  (9) 

Here  A  is  an  M  x/£  matrix  with  Vandermonde-structured  columns  (M  >K)  of  rank  AT . 
From  our  assumptions  it  follows  that  the  array  output  covariance  matrix  has  the  form 

R  =E  [x(r)xf(f )]  =  ARu  Af  +  cr2I  (10) 

where 

R„  4e(u(, )„'(()]  (H) 

represents  the  source  covariance  matrix  which  remains  as  nonsingular  so  long  as  the 
sources  are  at  most  partially  correlated.  In  that  case  ARUA*  is  also  of  rank  K  and 
hence,  if  A^A^  •••  >XM  and  represent  the  eigenvalues  and  the 

corresponding  eigenvectors  of  R  respectively,  i.e., 

R=Eai44'.  <12> 

I  =1 

2 

then  the  above  rank  property  implies  that  A^ +  1  =  A^-+2  =  •  •  •  =  =  a  .  As  a 

result  for  i  -  K  +  1,  K  +2,  •  *  •  ,  M 

R/J,  =  (aRua'  +  o2l)/J,  =  it2/?, 

(1)  Here  onwards  T,  (  *)T  =  f  stand  for  the  transpose  and  the  complex  conjugate 
transpose  of  ,  respectively. 
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or  equivalently, 

arma xp.  =  o. 

For  full  column  rank  A  matrix  and  nonsingular  RM ,  ( 13)  implies  A*/?.  =  0,  or 
0j*(uk)  =  0,1  =  K  +  1,  ■  "  ,M  ,  k  =1,2,  ••*, K . 
Schmidt  [2]  has  used  this  well-known  property  in  defining  the  estimator 

1 


(13) 


(14) 


Q(u) 


(15) 


where 


M 


G(«)  -  E  W/»(w)l: 


(16) 


i  =*  + 1 


Notice  that  £?(u>)  =  0  iff  w€ (wj, u>2,  •'*  ,  and  consequently  the  peaks  of  (15) 
correspond  to  the  true  directions  of  arrival. 

A  completely  different  point  of  view  can  be  developed  using  (14).  Since  the  K 
true  direction  vectors  a(cjj),  a(w2),  •  •  • ,  a(uK)  are  linearly  independent,  they  span  a  K 
dimensional  proper  subspace  called  the  signal  subspace.  Further,  from  (14),  this  sub¬ 
space  is  orthogonal  to  the  subspace  spanned  by  the  eigenvectors  PK  +  V  0K+  2,  *  •  •  , 
PS{,  implying  that  the  signal  subspace  spanned  by  a^),  a(u>2),  •  •  •  ,  a(uK )  coincides 
with  that  spanned  by  the  eigenvectors  @v  02,  •  •  • ,  0K.  Using  this  crucial  observation, 
the  eigenvectors  /?,,  fi2,  ■  •  • ,  0K  in  the  signal  subspace  can  be  expressed  as  a  linear 
combination  of  the  true  direction  vectors  (columns  of  A);  i.e., 

0,  =  E  wH)  .  1  =  1-2>  •••.*•  0?) 

k  =  1 


Define  the  M  xK  signal  subspace  eigenvector  matrix  as 


B  =  [/?,, /?2,  •••  ,PK 


(18) 


Using  (17) 


B  = 


K  K  K 

E  4iaK)’  E  c*2aK )«•'•’  E  <***("*) 

*-i  A-i  *  -i 


=  AC 


(19) 


_  ^ 
where  A  is  as  defined  in  (9)  and  C  is  a  KxK  nonsingular  matrix  whose  (/,/)  element 

is  ci  /VW .  Further,  define  two  matrices  and  B2  using  the  first  L  rows  and  the  Td 


to  (L  + 1)  rows  of  B  respectively  where  K  <L  <  M  - 1;  i.e., 

B,  =  [lz.  I  °i..M-2.]B 


(20) 


and 

B2  =  [°t.l  I  lL  I  (2D 

(2) 

Then,  we  have  the  following  interesting  result 

Theorem:  Let  7.  represent  the  generalized  singular  values  associated  with  the 
matrix  pencil  {  B: ,  B2  }.  Then 

\  ~  d-k  ,  k  =  1,  2,  •  •  •  ,  K  .  (22) 

Proof:  From  (20)  and  (21), 

Bj  =  At  C  ,  B2=A2C  (23) 

where 


1 

1 

1 

-1 

-1 

-1 

Mi 

Pi 

Pk 

,-(L  -  1) 

-(L  -  1)  .  . 

-(t  - 1) 

P\ 

Pi 

Pk 

(24) 


(2)  Here  I*,  represents  the  KxK  identify  matrix  and  O K  }  represents  the  KxJ  matrix  with  all 
zero  entries. 
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and 

-l  -l  -T 

fh  H  '  '  *k 

-2  -2  -2 

H  H  "  *k 

. =AXD  (25) 

-L  -L  -L 

H  h.  V’K 

with 

D  =  diag[n~l , /ij-1,  •  •  • , /i*1].  (26) 

Notice  that  Ax,  A2  are  matrices  of  size  LxK  and  D  is  of  size  KxK.  To  obtain  the  gen¬ 
eralized  singular  values  for  the  matrix  pencil  {  B: ,  B2},  using  the  above  representation 
we  have 

Br  -  7B2  =  AXC  -  ^AjDC  =  Aj(I^  -  7D)C  (27) 

Since  the  K  columns  of  B  in  (19)  are  independent,  B  is  of  rank  K  (M  >  K).  More¬ 
over,  from  the  definitions  of  the  rectangular  matrices  Bp  B2  in  (20),  (21),  these 
matrices  are  also  of  rank  K  (full  column  rank)  and  using  (23),  rank  (At)  =  rank  (C)  = 
K  since  L  >  K.  Thus,  from  (27),  the  singular  values  of  the  above  matrix  pencil 
{  Bt ,  B2 }  are  given  by  the  roots  of 

I  I/c  — /  D  1  =  0 .  (28) 

These  generalized  singular  values  correspond  to  the  complex  conjugates  of  the  diago¬ 
nal  elements  of  D;  i.e., 

lk  =  M*  ,  k  =  1, 2,  •••,/£.  (29) 

Notice  that  L  can  be  any  integer  between  K  and  M  - 1. 

Q.E.D 
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So  far  we  have  proceeded  under  the  assumption  that  the  ensemble  average  of  the 
array  output  covariance  matrix  is  available.  It  may  be  remarked  that  the  underlying 
rotational  invariance  idea  that  has  been  exploited  here,  is  basic  to  the  ESPRIT  scheme 
and  in  that  sense  they  are  equivalent  when  covariances  are  exactly  known.  Usually, 
these  exact  averages  are  unknown  and  in  practice,  the  estimates  obtained  from  the 
array  output  data  are  used.  In  that  case  these  methods  give  rise  to  different  algo¬ 
rithms,  and  in  actual  practice,  these  algorithms  will  perform  differently.  Often  the 
maximum  likelihood  (ML)  procedure  is  employed  in  computing  these  covariance  esti¬ 
mates.  For  zero-mean  M-variate  circular  Gaussian  data  x(tn),  n  =  1, 2,  *  •  •  ,  N  in 
(6),  with  unknown  MxM  covariance  matrix  R,  the  ML  estimate  S  of  the  covariance 
matrix  is  given  by  [15] 

s4e  iiiA).  (30) 

n  =1 

The  eigendecomposition  of  S  given  by 

S  =  ELE1  ,  EEf  =  I  (31) 

where 

E  —  [  et,  e2,  ,  c^-,  i  ]  ,  L  —  diag  [ /  j,  /2>  *  1  • 

is  usually  used  to  obtain  the  LxK  matrices  Ep  E2  by  replacing  B  by  E  in  (20)  and  (21). 
The  estimates  7(-,  *  =  1,  2,  •  •  • ,  K  of  the  true  angular  parameters  -y(,  i  =  1,  2,  •  •  •  ,  K 
are  then  given  by  the  generalized  eigenvalues  of  the  matrix  pencil  {Ej,E2}.  Simula¬ 
tion  results  using  this  procedure  is  presented  in  Fig.l  for  a  three-source  scene  with 
details  as  indicated  there. 

In  what  follows,  we  establish  several  performance  results  of  the  algorithm 
presented  here  using  the  statistical  properties  of  the  estimated  covariance  matrix  S 
derived  in  [16,  17].  These  results  are  in  turn  used  in  analyzing  the  performance  of  the 
estimated  generalized  eigenvalues  in  a  single-source  and  a  two-source  scene. 


-70- 


2.3.3  Performance  Analysis 

In  this  section,  we  examine  the  statistical  behavior  of  the  estimated  generalized 
eigenvalues  in  a  single-source  case  and  a  two-source  case  for  the  least  favorable 
configuration  L  =  K  as  well  as  the  most  favorable  configuration  L  -  M  - 1.  These 
results  are  subsequently  used  in  deriving  associated  threshold  expressions  for  resolving 
two  closely-spaced  sources.  For  L  =  K,  it  is  shown  here  that  the  bias  of  the  estimated 
generalized  eigenvalues  is  zero  and  the  variance  is  nonzero  within  a  1/A  approxima¬ 
tion.  This  behavior  is  unlike  the  MUSIC  scheme  where  within  a  1/A  approximation, 
the  bias  is  nonzero  and  the  variance  is  zero  [12,  16].  For  L  >  K,  the  situation  is  con¬ 
siderably  more  complicated.  In  particular,  it  is  also  shown  here  that  for  L  =  M  - 1  the 
estimated  generalized  eigenvalues  are  no  longer  unbiased  in  a  two-source  scene.  For 
sake  of  completeness,  the  exact  bias  expressions  together  with  their  variances  are  also 
given.  We  begin  by  considering  the  L  =  K  case. 


Case  1 :  The  Least  Favorable  Configuration  (L  =  K) 

A.  Single-Source  Scene 

In  Appendix  A,  the  mean  and  variance  of  the  estimated  generalized  eigenvalue  7j 
for  a  single-source  scene  are  shown  to  be 

+  o(^F>  <32> 


and 


Var{\) 


2M\a2 
N  -  a2)2 


+  o( 


N^N 


(33) 


Here,  o(l//Vv77 )  represents  the  terms  of  order  less  than  1/A.  From  these  results, 
7j  is  unbiased  within  a  first-order  approximation. 

2 

With  Aj  =  M  P  +  a  for  the  signal  subspace  eigenvalue  where  P  represents  the 
signal  power,  (33)  simplifies  into 


71- 


Var(%)  = 


2  M 


N 


1  1 
**  e 


+  o(nVn) 


(34) 


7 

where  £  =  M  P  /a  represents  the  array  output  signal- to-noise  ratio. 


B.  Two-Source  Scene 

With  the  help  of  (A.1),  the  mean  and  variance  of  the  estimated  generalized 
eigenvalues  7.,  i  =  1, 2  in  two  equipowered  uncorrelated  source  scene  are  shown  to  be 
(see  Appendix  B) 

srn-n  ■  ‘  -1’2-  <35) 

and 


Var(%)  = 


M^  +  ReG,;1^))  r 


2Ar(l  - 


d+  Ip,  I) 


(\  ~  of 


+  0  “  I  Pc  I) 


\  2 
V 


i\-o2f\ 


+  0W  ;  /  =  1’2 


(36) 


where 


,  1V,  sinMw. 

t/  \  /  \  j  (.m  **  f  \ 

Ps  =  a  H)a(w2)  =  <?  Msinu;  >  «</  =  (wi  "  “V/2- 


(37) 


Thus,  for  L  =  K,  within  a  1/iV  approximation,  7(.,  i  =  1,  2  are  once  again  unbiased 
estimates  with  finite  variance.  Simulation  results  presented  in  Fig.2  are  seen  to  be  in 
agreement  with  these  conclusions.  The  random  pattern  for  actual  bias  in  Fig.2  may  be 
attributed  to  computational  and  other  round-off  errors  and  indicates  the  absence  of 
l/N  term  there. 

To  simplify  (36)  further,  for  two  equipowered  uncorrelated  sources,  the  signal 


subspace  eigenvalues  are  given  by  [12] 
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\  =  M P  (1  ±  |^|)  +  <r2  ,  i  =1,2. 

With  (38)  in  (36),  finally  it  simplifies  into 

M  (2  +  cos  2u>d ) 

Var(%)  = - 

N (1  -  cos 2 ud) 


1 


^(1-1  Pj2) 


+  o( 


nVn 


1,2. 


(38) 


(39) 


These  expressions  can  be  used  to  determine  the  resolution  threshold  associated 
with  two  closely  spaced  sources.  For  a  specific  input  SNR,  the  resolution  threshold 
represents  the  minimum  amount  of  angular  separation  required  to  identify  the  sources 
as  separate  entities  unambiguously.  From  (35)  and  (39),  since  the  standard  derivation 
of  7(. ,  i  =  1,  2  is  substantially  larger  than  their  respective  bias,  it  is  clear  that  the  reso¬ 
lution  threshold  is  mostly  determined  by  the  behavior  of  the  standard  deviation.  In 
order  to  obtain  a  measure  of  the  resolution  threshold  for  two  closely  spaced  sources, 
consider  the  situation  shown  in  Fig.3.  Evidently,  the  sources  are  resolvable  if  sjl  and  72 
are  both  inside  the  cones  Cx  and  C2  respectively  or  equivalently  if  \arg (^j)-arg (~/( )  | 
<  ud ,  /  =1,  2.  Exact  calculations  based  on  this  criteria  turns  out  to  be  rather  tedious. 
But  as  computation  results  in  Fig.l  show,  £j1  and  72  are  usually  within  a  small  circular 
neighborhood  centered  about  7:  and  72.  This  suggests  a  more  conservative  criterion 
for  resolution;  i.e.,  the  sources  are  resolvable  if  71  and  72  are  both  inside  the  circles  c  x 
and  c2  respectively  in  Fig.3.  In  that  case,  the  maximum  value  of  the  common  radii  of 
these  circles  is  easily  shown  to  be  sinwrf .  Thus,  at  an  SNR  satisfying 


\ZVar(%)  =  1  sinwrf  (40) 

where  /  is  some  positive  integer,  using  (40)  we  finally  have  the  associated  threshold 
SNR  to  be 


Zi.k  ~ 


M  (2  +  cos  7jjj d ) 


2l2N(\  -  cos2w.)sin2w 


d  L 


1  + 


1  + 


4/2iV(l  -  cos  2wd )  sin2u;(/ 


1/2 


l  A/ (2  +  cos2wrf)(l  -  \ps  J 


(41) 
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Notice  that  calculations  for  Var  (7,)  in  (39)  has  been  carried  out  for  L  =  K(=2) 
case  and  hence  the  above  threshold  expression  also  corresponds  to  this  least  favorable 
configuration,  which  only  uses  part  of  the  available  signal  subspace  eigenvector  infor¬ 
mation  in  its  computations.  When  higher  value  of  L  is  used  to  evaluate  7.,  the 
corresponding  thresholc  xpressions  also  should  turn  out  to  be  superior  to  that  in 
(41).  These  conclusions  are  seen  to  closely  agree  with  results  of  simulation  presented 
in  Table  1.  Similar  threshold  comparisons  are  carried  out  in  Fig.4  for  the  MUSIC 
scheme  and  the  GEESE  scheme.  In  the  case  of  two  uncorrelated  sources,  by  equating 
the  actual  bias  at  the  true  arrival  and  middle  angles  Kaveh  et  al .  has  shown  the  resolu¬ 
tion  threshold  for  the  standard  MUSIC  scheme  to  be  [12] 

1/2 

j 

Fig.4  shows  such  a  comparison  using  (44)  with  /  =  2  and  (45).  From  Table  1,  the 


Zm  ~  \r 


20(A/  -2) 


1  +  1  + 


5(M  -2) 
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corresponding  SNR  values  are  observed  to  have  at  least  30  percent  probability  of  reso¬ 
lution. 

Case  2  :  The  Most  Favorable  Configuration  ( L  -  M  - 1) 

For  L  >K,  the  situation  is  much  more  complex  and  the  estimator,  7f,  i  =  1, 2  are 
no  longer  unbiased  within  1/N  approximation.  The  exact  bias  and  variance  expres¬ 
sions  can  be  computed  by  proceeding  as  in  Appendix  B.  These  computations  have 
been  carried  out  for  the  most  favorable  configuration  (L  =  M  - 1)  in  a  single-source 
scene  as  well  as  a  two-source  scene  and  the  results  are  summarized  below  [18]. 


A.  Single-Source  Scene 

The  mean  and  variance  of  the  generalized  eigenvalue  ^  in  this  case  with 
E[  |  u  x  |  2  ]  =  1  are 


and 


E  =  li  + 


(M  +  a2)  a2 
N 


M-2  2 

- -7l  +  0(l/N2) 

(M-l)2 


(46) 


Var( \)  = 


2[2(Af-l)(l  -/ij  coscjj)  +  M  /ij  coswjj 


N(M-iy 


1  J_ 

U  +  e2J 


+  o(l/N2) . 


(47) 


Interestingly  enough,  the  above  estimate  is  biased  even  within  a  1  /N  approximation. 
However  the  bias  and  variance  values  in  (46)  -  (47)  are  quite  small  compared  to  the 
variance  (34)  in  a  similar  situation  for  the  least  favorable  configuration. 


B.  Two-Source  Scene 

Once  again,  starting  with  (A.1),  after  a  long  series  of  algebraic  manipulations,  the 
mean  and  variance  of  the  generalized  eigenvalues  7(-,  i  =  1,  2,  in  two  equipowered 
uncorrelated  source  scene  can  be  shown  to  be 


E[%\  =j 


Me 


}Um 


(M-l)V 


ryr  + 

z  *L 


ro-ip,r ) 


T2(M,ud) 


(48) 
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where 


Ti(M,ud)=pie  +  q(e  +  r(.  ;  i  =  1,2. 


and  the  constants  p{ ,  qt ,  r. ;  /  =  1, 2,  are  as  given  in  Appendix  C. 


I '<*(%)  =  f-7  +  4-1  ,  i  -  1,2 

w  U  e2J 


where 


2  2Af 
u(M,A2)  = - 


3_  2  j  1  +  1  j  14  +  1231  1  _L_  7  _  15  95 

(A/-l)6ll  A/2J  A4  5i  M  A/2Ja2  M  M2  M3 


The  1/A  dependence  for  mean  and  variance  is  clearly  evident  in  the  simulation  results 
presented  in  Fig.6.  The  associated  threshold  SNR  in  this  case  can  be  obtained  with 
the  help  of  (40)  and  (49)  and  this  gives 


tl,M- 1  ~ 


6l2N 


1  +  1  + 


712N  (M  -1)6A2 
M5{M2- 2) 


For  the  same  source  scene  and  probability  of  resolution  discussed  in  Fig.4,  new 
simulation  results  are  presented  there  for  this  most  favorable  configuration.  As 
remarked  earlier,  the  SNR  required  to  resolve  two  sources  in  this  case  is  seen  to  be 
substantially  smaller  than  that  in  the  former  case  ( L  =  K).  In  particular,  to  resolve 
two  closely  spaced  sources  under  identical  conditions,  in  terms  of  input  SNR,  the  most 
favorable  configuration  seems  to  require  about  12dB  less  compared  to  the  MUSIC 
scheme  and  about  18dB  less  compared  to  the  least  favorable  configuration.  Once 
again,  utilization  of  all  available  information  in  this  (L  =  M- 1)  case  may  be  attri¬ 
buted  to  its  superior  performance.  Fig.5  shows  a  new  set  of  comparisons  for  another 
array  length.  From  these  results,  it  may  be  reasonably  concluded  that  when  all  avail¬ 
able  signal  subspace  information  is  exploited,  the  proposed  algorithm  outperforms  the 
MUSIC  scheme. 
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IV.  Conclusions 

This  report  analyzes  a  technique  for  estimating  the  directions-of-arrival  of  corre¬ 
lated  signals  by  making  use  of  certain  matrices  associated  with  the  signal  subspace 
eigenvectors  of  the  array  output  covariance  matrix.  This  is  based  on  the  well-known 
property  that  in  the  case  of  uncorrelated  and  identical  noise  field,  the  subspace 
spanned  by  the  true  direction  vectors  is  identical  to  the  signal  subspace  (i.e.,  the  one 
spanned  by  the  eigenvectors  associated  with  all,  except  the  lowest  repeating  eigenvalue 
of  the  array  output  covariance  matrix).  Using  a  first-order  asymptotic  analysis,  it  is 
shown  here  that  the  angle-of-arrival  estimator  in  its  least  favorable  form  is  unbiased 
and  has  nonzero  variance  in  a  two-source  scene.  Although  the  estimator  in  its  most 
favorable  configuration  turns  out  to  be  biased,  the  associated  resolution  threshold  in 
an  equipowered  two-source  scene  is  shown  to  be  substantially  smaller  than  that 
corresponding  to  the  standard  MUSIC  scheme.  Similar  comparisons  can  be  per¬ 
formed  in  a  coherent  scene  by  first  employing  the  standard  forward/backward 
smoothing  technique  to  decorrelate  the  signals  followed  by  the  method  described 
here,  to  estimate  their  actual  arrival  angles.  Once  again,  performance  comparisons 
can  be  made  for  a  two  coherent  source  scene  after  working  out  the  asymptotic  results 
in  a  similar  manner. 
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-1  0  1 
(a)  GEESE  scheme  with  L  =K 


-1  0  1 
(b)  GEESE  scheme  with  L  =M  - 1 


Fig.  1.  Simulation  results  for  a  mixed-source  scene.  Three  sources  are  located  at  30°, 
50°  and  70°.  The  first  two  sources  are  uncorrelated  and  third  source  is  correlated  with 
the  first  and  second  sources  with  correlation  coefficients  0.5+j0.29  and  0.21+j0.43, 
respectively.  A  ten-element  array  is  used  to  receive  the  signals.  Input  SNR  is  taken 
to  be  lOdB.  (number  of  simulations  =  50,  number  of  samples  =  100) 


□ 


variance 


log(BLAS) 

log(VAR) 


log(Number  of  samples) 

Fig.  2.  Bias  and  Variance  for  the  least  favorable  configuration  (L  =K  ( =  2)) 

Bias  and  variance  vs  number  of  snapshots  for  two  equipowered  sources.  A  ten 
element  array  is  used  to  receive  signals  from  two  sources  located  along  45°,  50°  with 
common  SNR  =  5dB.  Here  L  =  K  (=2)  and  each  simulation  consists  of  100 
independent  trials. 
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Table  1 

Resolution  threshold  and  probability  of  resolution  vs.  angular  separation  for  two 
equipowered  sources  ( K  =  2)  in  an  uncorrelated  scene,  (number  of  sensors  M  = 
7,  number  of  snapshots  =  100,  number  of  simulations  =  100) 


angles  of 

arrival 

ex  e2 

angular 

separation 

2wd 

SNR 

Prob.  of  Resolution 

MUSIC 

GEESE 

IBS' 

L  =  4 

1 

II 

-4 

4 

0.14 

5 

0.21 

6 

0.33 

8 

0.54 

16 

0.12 

0.64 

0.98 

25.00 

30.00 

0.1265 

18 

0.19 

0.19 

0.77 

■  ' 

19 

0.31 

0.20 

0.84 

20 

0.42 

0.20 

0.89 

21 

0.63 

0.20 

0.96 

22 

0.71 

0.25 

0.98 

23 

0.80 

0.31 

24 

0.91 

0.40 

0 

0.27 

1 

0.31 

2 

0.43 

3 

0.57 

9 

0.09 

0.58 

0.99 

4000 

45.00 

0.1  852 

11 

0.12 

0.16 

0.77 

1.00 

12 

0.30 

0.17 

0.83 

13 

0.32 

0.21 

0.91 

14 

0.48 

0.23 

0.94 

15 

0.73 

0.26 

0.97 

16 

0.75 

0.30 

0.99 

17 

0.84 

0.31 

1.00 

-5 

0.19 

-4 

0.23 

-3 

0.35 

_2 

0.51 

-1 

0.22 

0  57 

0 

0.28 

0.66 

! 

4 

0.08 

0.66 

0.98 

75.00 

so.oo 

0.2676 

6 

0.29 

0.11 

0.85 

1.00 

7 

0.41 

0.12 

0.87 

S 

0.57 

0.16 

0.92 

i 

<; 

0.74 

0.22 

0.n4 

10 

0.8 1 

0.25 

0.97 

1 1 

0  92 

0.30 

1.00 

i 

12 

0.99 

0.56 

1 

_ 1 
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INPUT 

THRESHOLD 
SNR  (dB) 

(£/M) 


ANGULAR  SEPARATION 

Fig.  4  Resolution  threshold  vs  angular  separation  for  two  equipowered  sources.  A 
seven  element  array  is  used  to  receive  signals  in  both  cases.  One  hundred  snapshots 
are  taken  for  each  simulation.  In  each  simulation,  the  associated  probability  of 
resolution  is  30  percent. 
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Fig.  5  Probability  of  resolution  as  a  function  of  ASNR  for  two  equipowered  sources. 
Angular  separation  (u^-u^)  is  taken  to  be  0.1  rad.  A  five-element  array  receives 
signals  and  one  hundred  simulations  with  100  snapshots  are  used  to  obtain  the 
probability  of  resolution  for  each  ASNR.  In  each  simulation,  two  sources  are 
considered  resolved  if  simultaneously  | arg£%)  -  a/g(7()|  <  u,,  i  =  1,  2  for  the 
proposed  GEESE  scheme  and  Q (w- )  <  Q{u„),  i  =  1,  2  for  the  MUSIC  scheme. 

A'f 

Here  Q  (u)  =  £  |e/a(ca)|2 

i=K  +  l 


0 


log(BIAS) 

log(VAR) 


log(Number  of  samples) 

Fig.6  Bias  and  variance  for  the  most  favorable  configuration  (L  =M  - 1) 

Bias  and  variance  vs  number  of  snapshots  for  two  equipowered  sources.  A  ten 
element  array  is  used  to  receive  signals  along  60°,  65°.  In  each  simulation,  the  SNR 
taken  to  be  3dB.  Here  L  =M  - 1  and  each  simulation  consists  of  500  independent 
trials. 
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Appendix  A 

Single-Source  Scene  Analysis 

With  6. ,  /  =  1,  2,  •  •  •  ,  K  representing  a  certain  set  of  normalized  estimated 
eigenvectors  associated  with  the  signal  subspace  eigenvectors  0V  /?2,  '  *  • ,  PK  from 
[12,  16,  17],  we  have 

6.  =  ki  W  +  J  +  0  (VA'2)  •  (A.D 

vrv  ;=1 
;>» 

where 


*»  -  1  -  W  S  K 1'  (A-2) 

;=i 

/>» 


Here  w/;.,  i  =  1,2,  •  •  •  ,M,  j  =  1,2,*  •  •  ,K  are  zero  mean,  asymptotically  Gaussian 
random  variables  with 


Eiwiiwki]  =  - iSik6ji  ’  1  ft  andfc  ft 

(A t-XjT 


(A.3) 


E  [  w..  vvw  ]  =  - ~6jt 6^  ;  i  fj  and  k  fl 

(A-  "A,)2 


(A.4) 


In  a  single-source  scene,  the  eigenvector  corresponding  to  the  largest  eigenvalue 
of  the  array  output  covariance  matrix  is 

t>x  -  [0...021.  •  ■  •  ]r  =  7=  [  l.V1.  ■  ■  ■  .  ^ '  '  ’Y  (A.5) 


and  from  (A.1)  the  estimator  for  is  given  by 


(A. 6) 


This  gives  ^  to  be 


1  M  <  1  M 

\  =  *llA?21  *  (*11  +  E  W;Ay  )/  /*2lO  +  ^  E  (A-7) 

/>!  Jfl 


l  M 

For  |  -j==-  J]  w;.  j/?2y  //?21 1  «  1,  we  can  simplify  (A.7)  as 


If  1  a/  f 

^  tn  +  W%wl*l 

it  1 

/  \ 


1  M  \  M  M  , 

7^  E  "jiV^a  +  77  E  E 
/v  ;=1  <  =  1  y  =  1 

it  1  <>!;>! 


7i  +  v77rn  +  yvr2i  +  °(V^2) 


(A.8) 


where 

ra-  e%,K/^.-^a/4]  <a-9> 

1 

iti 

r2i  =  E  E  »’,i%i  -  <W02iJ  •  <A-10) 

/  =  1  ;  =  1 
«>  1  ;>  1 

Since  the  limiting  joint  distribution  of  w-,  i  =  1,2,  •  ■  ■  ,M,  j  =  1,2,  •  •  •  , K  tend  to  be 
normal  with  zero-mean  and  the  odd-order  moments  of  zero-mean  Gaussian  random 
variable  are  zeros,  the  expected  value  of  rn  is  zero.  Thus, 

ER.l  =  -r,  +  ^£[r21]  +  o(i/w2) 

=  1,  +  ^E  E  £[M’iiB'yi]  +  «(1/a?2)  (a-11) 

/  =  1  ;  =  1 
<>!/>! 
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With  (A.4)  in  (All) 

^[71]=71  +  o(1/AT2)>  (A.  12) 

which  is  an  unbiased  estimator  for  7r 

Further,  with  the  help  of  (A8),  (A  12),  we  get 

Var(%)  =  £1 1  vjy  rn  +  Fr2il2] 

"£[^riirn  +  ^Re(rnr2-)]  +  o(l/N2).  (A- 13) 

The  term  inside  the  expected  operator  can  be  written  as 

W*n  +  ^R'(rur2v  = 

Til  E  ”nwh  K/^2,  -  /W4]  K/^t  -  PiAj/Pn]  + 

/  =  1  ;  =  1 
«>!;>! 


_ 2 _ 


M  M  M  P\ 

ReEES  V,>/i  t 

*  =  i  /  =  i  y  =  i 

*  j*  i  «>  U  j*  i 


*  .  f  ^  ^11^2*  1  [  PuPyPij 


(A.  14) 


Once  again  noticing  that  the  odd-order  moments  of  zero-mean  Gaussian  random  vari¬ 
able  are  zero,  we  have 

wv - 77 s  s  £h.«’/i] K/«2i -*w4]’  +o('/a'2). 

<  =i  ;  =i 
/>  1  ;>  1 

(A.  15) 


Using  (A.3)  in  (A.  15)  and  with  (A.5)  we  have 
1  M  M  \\k 

''“■Oi)- ate - rl^« 

‘■2  (W 
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iv i  a.^u  Mr 

= - —  E  l^|2+l/J2t|2-2Re(M1/?i/32ll)]+0(l/W2).  (A.  16) 

N  (Aj  -  O)  k=2L  J 

To  simplify  this  further,  notice  that 
M 

E  PikPjk  =Sij  '  i  =  1, 2,  •  •  • ,  A/  and;  =  1, 2,  •  •  • , M .  (A.  17) 

*=i 


(A.  17)  together  with  (A.5)  gives 

M  ,  M  ,  1 

E  l^r=  E  l/?2*l  =1-  M  (A- 18) 

A  =2  /fc  =2 

and 


a/  -i 

E  OJA* •  (A.  19) 

k=2 


Finally,  with  (A.18)-(A.19)  in  (A.16)  we  have 

2M\o2 

Var  (%)  = - +  o  ( 1/N2) .  ( A.20) 

N  (. X j  -  a2)2 

i 

i 
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Appendix  B 

Two-Source  Scene  Analysis 

For  two  equipowered  uncorrelated  sources,  the  eigenvectors  in  the  signal  sub¬ 
space  of  the  array  output  covariance  matrix  are  given  by  [12] 


@i  = 


U1±U2 


\/2(l±kl) 


for  Si  (Mud )  >  0  ,  i  =  1, 2 


where 


....  sinA/w,  .... 

4.V„.  w.^ 


PS  =  ar(Wi)a(w2)  =  e 


M  sinw , 


=  e 


and 


(M  - 1)/2  /  ,  (M-  l)/2  ,  , 

ut  =  nl  afwj)  ,  u2  =  /^  a(w2) 


(B.l) 


(B-2) 


(B.3) 


with  a(u)  as  defined  in  (4).  Using  these  eigenvectors  and  with  the  help  of  (19) -(21) 
and  L  -  K,  we  form  the  matrix  pencil  {  Bj ,  B2  }  and  compute  the  generalized  eigen¬ 
values  of  this  matrix  pencil;  i.e., 


’@11  @12 

@21  @22 

^11  ^@21  @12  7  @22 

-  7 

= 

=  0  (B.4) 

-@2l  @22  ■ 

@31  @32- 

@21~^@31  @22  ~  7 @32 

th  th 

where  /?..  represents  the  i  element  of  the  j  eigenvector.  Then,  (B.4)  can  be 


simplified  as 

At72  -  A27  +  A3  =  0 

where  Ap  A2,  A3  are  the  determinants  defined  as 


(B.5) 


@21 

@22 

@n 

@12 

^11  ^12 

A,4 

•  A2  = 

t> 

u» 

ll> 

@31 

@32 

@31 

@32 

@21  @22 

(B.6) 


From  (B.6)  and  (B.l) -(B.3),  we  find  the  following  useful  identities 

1 


^3  ~  @1  1@22  Pl\P\2  ~ 


M(l-|»  |2)l/2 


{M  -  l)/2  (\t  -  l)/2,  -1  -  K 

Mi  M2  (Mj  “  M:  )  (B.7) 


Further,  using  the  above  relations,  the  discriminant  of  (B.5)  can  be  expressed  as 


D  ^  A l  -  4A,A3  =  A3V1  "  H1)1-  (B.10) 

Thus,  the  roots  of  (B.5)  are  given  by 

a3(^'1 + z^-1)  ±  A3(/i1~i  -  ij^1) 

7/  =  =  Ml  or  H2  (B.ll) 

2  A3  Mi"  M2" 

Here,  ^  corresponds  to  +  sign  and  72  =  Mi  to  -  sign. 

Now,  with  the  help  of  the  equalities  (B.7)-(B.ll),  we  consider  the  estimated 
case.  From  (A.1),  we  have  the  estimated  eigenvectors  corresponding  to  the  signal 
subspace  as 


it* 


where  ki  is  defined  as  (A.2).  In  a  two-source  scene,  the  generalized  eigenvalues  of  the 
estimated  matrix  pencil  {  Ej ,  E2 }  given  by 


ell 

^  12 

A 

e2l 

e  22 

=  7 

-e21 

e22- 

e  31 

e  32- 

Since  e(  =  c(  e^‘ ,  i  =  1, 2,  •  ■  •  ,K,  the  above  equation  reduces  to 


(B.13) 


A  A  A  A  A  A 

C11  3fC21  C 12  7C22 


c 21  “  7C 31  C22  -  7 C32 


A  .2  A  A 

=  Aj7  -  A27  +  A3  --  0 


(B.  14) 


In  (B.13)  and  (B.14),  et-  and  represents  the  i'h  elements  of  the  estimated  eigen- 


vectors  Cj  and  c j,  respectively.  Following  (B.14),  define  Aj,  A3  as 


C21 

^22 

C11 

C12 

C11 

C12 

<11 

«r 

a  A 
»  ^2  " 

a  A 
’  A3  “ 

C31 

^32 

^31 

C32 

^21 

C22 

(B.15) 


To  fine  a  first-order  approximation  for  A1?  anb  A3,  we  begin  with  the  interele¬ 
ment  multiplication  of  c( ,  i  =1,  2.  This  can  be  written  as 


Cpieq2  ~  k\k2 


Ppfiql  +  ^ 


M  M 

E  WjAjPql  +  E  WjlPqjPpl 

J= 1  ;=1 

it  1  ;>2 


1  M  M 

+  Tv  E  E  "k^nPpkPqi 

Ar  =  1  /  =  1 


+  o(l/JV2). 


(B.  16) 


With  (B.16)  in  (B.15),  we  have 

A1  =  ^21^32  “  ^31^22 


k\k2 


A‘+  ^7 


M  M 

E  Wjl(@2j@32  ~  PljPll)  +  E  Wj2^3j^2l  ~  PljP$\) 

j- 1  ;'=i 

;>i  ;>2 


1  a/  w 

+  Tv  E  E  wklwl2^2k^y  ~  ft 3k  @ 21  ) 

/t  =1  /  =1 


k  f  l  l f2 


+  o(\/Nz). 


Defining 

A/;M  ~Pik@jl  ~  @jk  @il 

(B.17)  can  be  written  as 


(B.17) 


(B.  18) 


Ai  +  v/77  rn  +  tv  1 21  +0W/NI 


(B.  IV) 
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where 


M  M 

ril  =  E  Wjl^23j2  +  E  Wj2^32j  1 
;'=i  J =1 


M  Af 

*21  =  E  S  WklWl2^23Jcl  • 
Ar  =1  /  =1 
A^l/^2 


Similarly,  we  have 


^2  ^1^2 


A2  +  \/NTl2+  UTn 


+  o(l/AT) 


where 


A3  kik1 


A3  +  y/tf  ri3  +  ATr23 


+  0(1/^) 


M 

M 

E  Wjl^l3j2 

+  E  M;2A31;l 

;=  i 

y=i 

m 

\n 

M 

M 

E  1^12/2 

+  E  W;2A21;1 

;-i 

y=i 

it  i 

in 

M  M 

*22  =  E  E  Wk\W12^\3kl 

k  =1 / =1 
kf Ilf  2 


M  M 

’  *E  =  E  E  Wk  Iwl2^l2kl  * 

A  =1 / =1 
kf\lf2 


The  generalized  eigenvalue  of  (B.14)  within  a  first-order  approximation 
found  by  using  (B.19)-(B.26).  To  see  this,  let 


r,  = 


Nr* 


i  =  1,  2,  3  , 


(B.20) 


(B.21) 


(B.22) 

(B.23) 


(B-24) 


(B.25) 


(B.26) 

can  be 

(B.27) 


and  with  (B.14),  (B.19),  (B.22)  and  (B.23),  the  generalized  eigenvalues  have  the  form 
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/\  ,  /v  2  .A  A  .1/2 

A2  ±  (A2  -  4A1A3)1/2 


T? 


2A. 


(A2  +  r2)  ±  (A22  -  4A:A3  +  2A2T2  +  r2  -  4(a3i\  +  Axr3  +  r1r3)) 

2A1(l  +  ri/A1) 


1/2 


(B.28) 


Here,  I\  defined  in  (B.27)  represents  the  perturbation  of  A(-  from  A(-  and  for  large  N, 

from  (B.19)  and  (B.27)  noticing  that  l^/Aj  |  «  1,  we  can  rewrite  (B.28)  as 

1/2 

r  <  (  oa  r  r  +  Ar+r  r.ni 

1 


7.  _ 


2Ai  L 


(a2  +  r2)  ± 


D 


1  + 


2A2r2  +  r2  -  4(A3rj  +  A:r3  +  i\r3)  ] 


D 


,2  \ 


1  - 


(B.29) 


where  D  is  given  by  (B.10).  Once  again,  for  large  N  we  have 


2A2r2  +  r2  -  4(A3rl  +  Atr3  +  r^) 


D 


(B.30) 


which  allows  one  to  further  approximate  (B.29)  as 


1,  ~ 


&2±'fP 

2A, 


i2  ^ 


1  -  -  + 


*1  A,2 


2 Vd  r2  ±  [2A2r2  +  r2  -  4(a3i\  +  Atr3  +  r,r3)] 


+ 


4a  yz> 


rl  rl 
1  -  —  +  — 


2  'i 


ll 


+ 


[2A2r2  +  r22-4(a.,r|+A,r3  +  r|r,)]2 

16A  P'fD 


1  - 


IT 


(B.31) 
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Neglecting  terms  formed  by  combinations  of  triple  products  of  rt,  r2  and  r3,  (B.31) 
reduces  to 


r  r2 

Li  Li 

%  ~  ii  (i  -  —  +  — )  + 

4 


(x/p  ±  A2)r2  T  2(A3r1  +  Ajtj 

2A/P 


{'Jd  ± A2)r1r2 + 2(A3r2 + A1r2/4)  [A2r2-2A3r1-2A1r3]2 

- - : - + - — -  (B.32) 

2A1Vp  4A  P'/D 

Finally,  using  (B.27)  and  retaining  only  those  terms  of  order  greater  than  or  equal  to 
l/N ,  we  have 


1  _  1 


(B.33) 


where 


li  (v'D  ±  A2)ri2  +  2(A3ru  +  Ajfu) 


=  -— rn  + 

Ai 


2a  yn 


(B-34) 


and 


1 

A 


®2J  .  ^21  +  ,  ^11  + 

1  A,2 


(Vd  ±  A2)rH  +  2(A,r21  +  at3,) 


2A  jx/P 


(Vd  ± A2)r11r12T2(A3r2  +  A,r22/4)  [A2r12-2A3r11-2A1r0]: 


2A  ,W 


4A1Px/P 


(B.35) 


<t>1(  and  4*^  in  (B.34)-(B.35)  can  be  further  simplified  with  the  help  of  (B.7)-(B.ll). 
For  i  =  1  and  7j  =  we  have 

^ii  =  “  ~  ~  ^12  +  ^3] 

A3(mi"  -m2’  ) 


and 
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^A2r21  ^22  +  *23  hFll  ^11^12  +  ^12^ 

$21  =  “  + 

A3(^r 1  -  M2"1)  A3V  1M2~  W  1  -M2_1) 

[frT1  +  M2~1)r12  -  2TU  -  2y Vrj2 

>a2  -1  -1/  -1  -1x3 

4A3/i!  “  A^2  > 

Similarly,  for  i  -  2  and  72  =  M2  we  have 

*12  =  T  T  ~  ^iri2  +  ri3l 
A  3(Mi  'M2 l) 

^1*21  ~  **1*22  +  r23  MfTii  “  M^nT^  +  T12/4 

^22  — 

A  /  “I  -U  A  2  "I  "I/  "I  -lx 

A3(Mi  -M2  )  A3^1  M2  (Mi  -M2  ) 


(B.37) 


(B.38) 


[(«;’  +  ^'l)r12  -  2r„  -  Zi»f  V^ul2 

+  -  (B.39) 

..2  -1  -1,  -1  -K3 

4A3Mi  M2  (Mt  ~M2  ) 

From  now  on,  with  the  statistical  properties  derived  in  [16,  17],  we  compute  the 
mean  and  variance  of  the  estimated  generalized  eigenvalues.  Consider  the  first  gen¬ 
eralized  eigenvalue,  7r  Then,  from  (B.33),  the  expected  value  of  \  is 

mi - h +  +  + >•  <B-4°) 


With  (B.20),  (B.24)  and  (B.25),  it  is  easy  to  verify  that  £[4^]  consists  of  the  first- 
order  moments  of  w .  which  gives  £  [$u  ]  =  0  and  hence 


=  7i  " 


e  [  m^i  M2r22  +  r^] 
N  —  M2;-1) 


e[h rfi  ~  M2rtlr12  +  rf2/4j 
N  A*n[  1M2"  1  “  M2"1) 


£[[(mj  +  m2  )r12  2rn  2^  H2  r13]  j 

4A7  A3Vr  V  Vi"  1  -  M2"1)3 


+  o( 


wv/77 


). 


(B.41) 
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With  (B.21),  (B.26)  and  (B.26),  the  terms  inside  the  first  expected  operator  can  be 
written  as 


**2*  21  **2*  22  +  *23  ”  2  2  WklWl2^fJ2^23kI  hP^illkl  +  ^12*/)*  (B.42) 

jfc=l/=l 


With  (A.4)  in  (B.42)  we  also  have 


,  mm  2 

^[**2*21  “  **2*22  +  *^23  ]  =  2  2  ~  **2^13 k!  +  *^12A-/) 

*=1  /=1 
kt\lfl 


=  T^^2321  ~  ^2^1321  +  *^1221)  =  0  (B.43) 

-  v 


since,  from  (B.18),  (B.7)-(B.9),  it  is  easy  to  show  that  A^  =  -Ap  A1321  =  -A2  and 

^1221  =  "*V 

Also,  with  (B.20)  and  (B.24),  we  can  write 


M  M 

**2*\l  “  ri2/^  =  2  Wj  1  (**2 ^23; 2  ~  ^13> 2^ )  +  2  W;2 (**2  *^32/  1  “  ^31;  l/2  ) 
7=1  7=1 

;>i  ;>2 


"  2  (^'l  0*2^237  2  4Ai3y2/2 )  +  ^7  2  (**2  ^327  1  ^31;1/2)j  (B.44) 


since  from  (B.18) 


A(.;W  =0  for  fc  =  l .  (B.45) 

Hence,  together  with  (B.44)  and  (A.4),  we  can  easily  show  that 

Ell&u-  ^„r12  +  4/41-0.  (B.46) 


Similarly,  for  the  exnected  value  of  the  last  term  in  (B.39),  with  (B.20),  (B.24) 


and  (B.25)  we  can  write 
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0*1  +  A*2  )^12  2Tii  M 2  ^13 

=  E  1  ((^r 1  +  fh  1)A13>2  -  2^23/?  -  V  V 

y =i 

+  E  w>  2(^*1  +/A2  )Ajl;l  ~^32;1  ”^*1  ^2  ^21;  l) 
y=i 
;>2 

=  E  (m';  i((Mi  ^  M2  )^13;2  "  ^23;  2  “  ^1  ^2  ^12/2) 

j  =3 

+  wy2((^l  +^2  )^31>1  "  2A32/1  ~  2^  M2  A21;l)  )  (B-47) 

Here,  once  again  we  use  the  fact  of  (BAS).  Then,  with  (B.47)  and  using  (A.4),  it  can 
also  be  shown  that 

£[[(m, r1  +  M2_1)ri2  -  2TU  -  2/z1"1/x2"lrJ2]  =  0.  (B.48) 

Finally,  with  (B.43),  (B.46)  and  (B.48)  in  (B.39),  we  obtain 

£t,‘!",‘  +  0(7^)  (R49) 

Thus,  within  a  first-order  approximation,  the  sample  generalized  eigenvalue  £jl  is  an 
unbiased  estimator  for  7r 

With  the  help  of  (B.33),  (B.36),  (B.20),  (B.24)-(B.25),  and  some  algebra,  it  is 
easy  to  compute  th°ir  variances.  Now,  with  ( A.3) 

KarR,)  =  -i£[|$|1|2] 


-97- 


M  M 

E  E  ElwnwJ\  Vilj 

/=iy=i 


MM  MM  MM 

+  E  E  E[wn w^n;  +  £  E  £ l ^2^*1 177,7/  +  E  E  ]//.//* 

»  =  1  j  « 1  i  =  1  j  =  1  i  =  1  j  =  1 


=  1 


=  1 

*>2;>  i 


«>2;>2 


a'|a3|2|m;1-^1|j 


M 

E 


M 


«>i 


i//i2+ 


Af 

E 


V/ 


«>2 


i  (>2‘\) 


W 


(B.50) 


where 

=  ^2A23;  2  “  ^13;  2  +  A12;2  (B-51) 

II j  =  V?&32ji  ~  f*2 A31/l  +  A2iyi  •  (B.52) 

Also,  from  the  definition  of  in  (B.18)  we  notice  that  /.  in  (B.51)  is  zero  for  j  =  2 
and  II j  in  (B.52)  zero  for  /  =  1.  Therefore,  with  A3  =  A4  =  *  •  •  =  XM  =  o 2,  (B.50)  is 
simplified  to 


Var(%)  = 


M 

E 


^IV1  —  ji2  ,=3 


Aj<7 


v 

(*i  -  ° ) 


|/,l2  + 


V 


(A, -a2)2 


m 


(B.53) 


Now,  we  evaluate  /(  and  II i  from  (B.18)  and  (B.l).  First, 

/»  =  ^2 A23< 2  “  ^2A13j2  +  A12/2 

=  ^2 (^2/^32  ~  ^'^22)  ~  ^2^1/ ^32  ~  +  ^22  ~  ^2i^\7) 

,, 

=  ~  [^i  Pi,  “  (P2  +  P '  )^2i  +  J 


(B.54) 
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Also,  from  (B.52) 

11 i  =  4A32il  ~  1*2*3111  +  *2Ul 


(M  -  l)/2  1,  -1  -1\ 

~Mi  M2KM2  ~Mi  ) 


^2M(l+\ps\) 

(B.53)  together  with  (B.54),  (B.55)  gives 


bh  V  X-  -  (Jh 1  +  ‘)4-  +  4  ]  •  (B-55) 


Far^)  = 


1 

AjCr2 

W|A,|2 

(At -a2)2 

[  (Aj  -  a)  2A/(1  -  \ps  I)  (A2_ay  2M(l+|p,l)J 


e  14  VX  -  041  +  /*!  +  4- 12 

1  =3 


(B.56) 


Replacing  A3  with  (B.7),  this  gives 


Var{%)  = 


M 


2N\mi  1  -  M2~ 1 1 2 


(1+  Ip,  I) 


\o 


f\  2x2 

(Ai  -  a  ) 


+  (i-  kl) 


X  2 

V 


(A, -a2)2 


E  1/hVX  -  (41  +  4X-  +  4- 12-  (B-57) 

/  =3 

To  simplify  this  further,  notice  that 

M 

E  44  =  4/  >  *  =  1,2,  "  •  ,M  and  j  =  1, 2,  •  •  • ,  Af  .  (B.58) 

*  =  1 

For  /  =  j  =  1,  (B.58)  together  with  (B.l)  gives 

E  =  - - - -[l  -  |^|Re(^<"'1)/V"'1>/2)]-  (B-59) 

‘-3  A/(l  -  l/ij  |2) 


Similarly, 
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E  l/*»  I2  =  1  - - - - —  [l  -  l„,  I  Re(Ml<M  -3)V<M '3>/2)]  (B«>) 

t-3  Af(l-|ps|2) 

and 

E  103*  I2  -  1  - - 2 - 7  [l  -  I*.  I  Ref,.;"  •  " S)/2)]  •  <B-61) 

‘•3  w(i-kl) 

Also,  for  i  =  1,/  =2  we  have 

„  x  I  I  /  ~{M  ~  3)/2  (M  -  l)/2  (AT  -  l)/2  -(A/  -  3)/2> 

M  0*1  +  /*2)  ”  IP,  I  0*1  /*2  +  Mi  A*2  / 

S  ft  \k  ft 2k  ~  ~  2 

i-3  Mfl-lpJ2) 

(B.62) 

,  (f  X  u  /  -<M  -5)/2  (M  -3)/2  (M  -3)/2  -(A/  -5)/2v 

A/  (Mi  +  AV  "  k  K^i  ^2  +  /*i  P2  ' 

S  @  2k  $ 3k  =  ~  I 

*-3  M(l  -  \ps  |2) 

(B.63) 


and 


ftzkftik 
k  =3 


2  +  ^-2)  -  k  1  w(A/  -  1)/2mT  - 5)/2  +  f  ~  5)  V"  ~  1)/2> 


A/(l-kl  ) 


(B.64) 


With  (B.59)  -  (B.64),  the  last  term  in  (B.57)  can  be  written  as 


E  ImTVX  -  (^‘l  +  *h"V»»  +  4 12 

«  =3 


-  E  K 12  +  h"  +  ^-‘I2l4  I2  +  I  A,  I2  -2Re[„,- V(m,  + 

“X 


+  0*1  +  ^2  )^2 f'^3/  ^1^2^3,'  ft\i  ]] 


=  4  +  2Re(/x1  1m2). 


(B.65) 
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Finally,  using  (B.65),  (B.57)  reduces  to 


Var(%)  = 


M  <r2(2+Re(/i1  1/z2) 


The  mean  and  variance  of  identically  the  same  as  that  of  \  and  the  covariance 
between  and  72  is  given  by 

M  a2  ( 2+Re(/x1  1 n 


2v2 


(i+kl)+ 


*2 


M  2\2 
(A2~a  ) 


d-kl) 


.  (B.66) 


r1, 


'ov(  7P72)  =  “ 


.  <M-5)/2  -<M-5)/2 

P  i  n. 


/\  2\2 


(i+k!)- 


*2 


(V*2)2 


(B.67) 
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Appendix  C 

Bias  Constants  in  a  Two-Souce  Scene 
p,  =  (3A/3-12M2+15M-6)  + 

( 0.704M5  -4.206M4 + 8.793M3  -  4. 195Af2  -  27.194M  +  81.592 )  u>2  + 

( 0.0642A/7  -  0.42A/6 + 0.945M5  +  0.377M4  -  6.937M3  +  53.93 M2 

-61.517M  + 12.417  +  o(w*) 

=  ( 3M4  -  18A/3 + 39Af 2  -  36M  + 12 )  + 

( 0.2M6  -  2.6M5  + 1 1.45A/4  -29.3M3 + 38.95A/2 + 46.5M  -212.98)w2  + 

( 0.078M8  -  0.804A/7 + 3.54M6  -  9.48A/5  +  18.66A/4  -  33.37M3  +  6 1 .32M2 

-133.61A/  + 199.34  )wj  +  o(w*) 

rx  =  (  -3M4+ 15A/3-27A/2+21A/  -6)  + 

(  -  0.2A/6  +  1.9M5  -  6.88A/4  +  14.09M3  -  10M2  -  69. 1M  +  200.63 )  wj  + 

(  - 0.053M8 + 0.492A/7 -  1.884A/6  +  1.535A/5+10.8W4-45.02M3  +  78.99AT 

-26.29A/ -80.31  )w4  +  o  (w*) 

p2  =  ( 6iV/3  -  24A/2  +  30M  - 12 )  + 

(  -  0.602A/5 + 3.606A/4  -  14.406M3  +  33.60 1M  2  -  107.398M  +  229.2 )  w2  + 

( 0.2572A/7  -  1.89A/6  + 6.235M5  -  10.309M4  -  0.697M3 + 50.68A/2 

-117.78A/  +70.12  )w4  +  o(wJ) 
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q  2  =  (6A/4-36A/3+78A/2-72A/  +  24)  + 

(  -0.602M6+3.806A/5-9.115A/4+11.41A/3-27.6A/2+  186AZ  -445.96  + 

( 0. 173 M8  -  1.702A/7 + 3.988A/6  - 17.22 1M5 + 30.96A/4  -  64.43M3  +  144.98M2 

-264.61A/+398.12)u;4  +  o(a^) 

r2  =  (  -6A/4+30A/3-54A/2+42A/-12)  + 

( 0.602A7  6  -3.213A/5  +  5.51M4  -3.833A/3  +  42.233M  2  -  116.25A/  +  493.5 )  wj  + 
(  -0.173A/8+  1.446A/7-5.035A/6  +  5.226A/5+  17.42A/4-81.96A/3+  167.84A/2 

-  134.45A/  - 102.28 )  w4  +  o  (w*) 
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